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DATA  COLLECTION  AND  ADMINISTRATION  PROCEDURES 
FOR  THE  JOB  PERFORMANCE  MEASUREMENT  SYSTEM 


SUMMARY 

The  Human  Resources  Directorate  of  the  Armstrong  Laboratory  (AL/HR),  formerly 
the  Air  Force  Human  Resources  Laboratory  (AFHRL),  developed  a  set  of  job  per¬ 
formance  measures  to  serve  as  criteria  for  validating  selection  and  classifi¬ 
cation  tests  and  evaluating  training  systems.  This  performance  measurement 
technology  included  work  sample  tests,  rating  forms,  job  knowledge  tests,  and 
questionnaires  which  focus  on  the  job  proficiency  of  first-term  enlisted 
personnel.  This  report  documents  the  planning  and  implementation  of  the 
large-scale  data  collection  efforts  required  to  execute  the  research  mission. 


I.  INTRODUCTION 

The  Joint-Service  Job  Performance  Measurement  (JPM)  Project  was  initiated 
in  1980  with  a  Congressional  mandate  that  the  primary  selection  device  used  by 
the  Services,  the  Armed  Services  Vocational  Aptitude  Battery  (ASVAB),  be 
validated  against  job  performance  criteria  (Wigdor  &  Green,  1986).  Since  that 
time,  the  Air  Force  Human  Resources  Laboratory  (AFHRL)  has  conducted  exploratory 
and  advanced  research  on  numerous  performance  measurement  methods  and  procedures. 
The  result  of  these  efforts  is  a  technology  for  systematically  measuring  job 
performance.  This  technology  is  referred  to  as  the  Air  Force  Job  Performance 
Measurement  System  (JPMS).  Data  collected  with  the  JPMS  not  only  provides 
information  about  the  relationship  between  ASVAB  test  scores  and  job  performance, 
but  can  assist  in  setting  Air  Force  Specialty  (AFS)  enlistment  standards.  In 
addition,  the  JPMS  can  be  used  to  evaluate  training  programs  and  serve  as 
criteria  in  other  research  and  development  efforts. 


Selection  of  AFSs 

Eight  AFSs  were  identified  for  study  under  the  JPM  Project  (Table  1). 
Selection  of  AFSs  was  based  on  a  number  of  factors  including  the  ASVAB  Aptitude 
Index  (AI)  composite  used  to  classify  recruits  into  the  specialty  and  the  number 
of  airmen  working  in  the  specialty  (Laue,  Hedge,  Wall,  Pedersen,  &  Bentley, 
1992).  Although  the  eight  AFSs  comprise  only  four  percent  of  the  total  number 
of  enlisted  AFSs,  over  nine  percent  of  the  first-term  airmen  were  assigned  to  one 
of  these  eight  specialties  (Occupational  Research  Data  Bank,  1986).  Thus,  a 
sample  from  each  AFS  should  provide  an  appropriate  test  of  the  validity  of  the 
ASVAB  for  predicting  job  performance. 
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Table  1.  Sanple  Characteristics  of  Each  Specialty 
in  the  JPM  Project 


AFSs  (by  ASVAB  Aptitude  Index) 

First-termer 

Population 

Sample 

N 

Mechanical 

Aerospace  Ground  Eq[uipment  Mechanic  (423X5) 

4659 

261 

Jet  Qigine  Mechanic  (426X2) 

57C9 

255 

Administrative 

Information  Systems  Radio  Operator  (492X1) 

1020 

156 

Personnel  Specialist  (732X0) 

5224 

197 

General 

Aircrew  Life  Support  Specialist  (122X0) 

1700 

195 

Air  Traffic  Control  Operator  (272X0) 

1900 

191 

Electronic 

Precision  Measurement  Equipment  Laboratory 
Specialist  (324X0) 

1671 

138 

Avionic  Ccnmunicatians  Specialist  (328X0) 

1000 

98 

JIMS  Project  Timelines 

Development  and  administration  of  the  JPMS  instnments  were  staggered  over 
time  in  three  phases  as  depicted  in  Figure  1.  AFS  426X2  was  the  first  AFS 
selected  for  study.  The  instnxnent  development  and  data  collection  procedures 
employed  for  this  specialty  served  as  prototypes  for  subsequent  efforts.  Across 
the  three  data  collection  efforts,  modifications  and  adaptations  were  made  to  the 
prototype.  Ilie  third  effort  represents  application  of  the  best  methods  to  date 
and  is  the  focus  of  this  report. 


Selection  of  Performance  Measures 

Several  measurement  methods  were  identified  from  the  performance  appraisal 
literature  as  appropriate  for  use  in  the  JPM  Project  (Kavanagh,  Borman,  Hedge, 
&  Gould,  1986).  Work  sample  tests,  in  the  form  of  hands-on  performance  tests  and 
interview  tests,  were  developed  for  each  of  the  eight  AFSs.  Referred  to  as  the 
Walk-Through  Performance  Test  (WTPT),  these  hands-on  and  interview  measures 
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required  job  incvirbents^  to  perform  or  describe  the  steps  necessary  to 
successfully  conplete  a  sarnple  of  tasks  representative  of  the  job  of  a  first-term 
airmen  in  each  AFS.’ 

A  second  measurement  technique  selected  for  utilization  in  the  JR4S  was 
performance  rating  forms.  Like  the  WTPTs,  rating  forms  were  developed  and 
administered  to  personnel  within  all  eight  AFSs.  Rating  forms  were  connpleted  on 
incvrbents  by  the  incimbents  themselves  (i.e.,  self  ratings),  their  supervisors, 
and  their  peers  (i.e.,  co-workers).  Forms  ranged  in  level  of  detail  from  very 
specific  task-level  ratings  to  ratings  on  general  dimensions  of  performance. 
Each  of  the  rating  forms  employed  a  5-point,  adjectivally-anchored  rating  scale. 
Whenever  possible,  specific  behavioral  descriptions  were  included  in  the  scales. 

A  third  type  of  measurement  method  utilized  in  the  third  development  and 
data  collection  phase  of  the  JPM  project  wais  knowledge  testing.  Two  forms  of 
knowledge  tests  were  administered  to  incumbents  in  four  AFSs  (i.e.,  AFSs  423X5, 
732X0,  122X0,  and  324X0).  Job  Knowledge  Tests  (JKTs)  covered  knowledge  required 
to  perform  those  taisks  included  in  the  WTPT.  The  Apprentice  Knowledge  Test 
(AKT),  an  AF  test  used  in  many  career  fields  to  allow  airmen  to  bypaiss  initial 
technical  training  school ,  was  also  administered  to  personnel  in  these  four 
specialties. 

In  addition  to  these  performance  measures,  questionnaires  were  developed 
to  collect  background  and  experience  information.  These  questionnaires  were 
completed  by  participants  across  all  eight  AFSs.  All  of  the  performance  measures 
will  be  described  in  more  detail  in  a  following  chapter.* 


Overview 

This  report  documents  the  actions  and  procedures  taken  to  collect  data  with 
the  measurement  methods  described  adxjve.  Figure  2  provides  an  outline  of  all 


‘The  term  "incumbent"  refers  to  a  first-term  airman  who  was  selected  to 
complete  the  entire  battery  of  JPMS  instruments,  including  the  WTPT.  The  term 
will  be  used  to  distinguish  these  participants  from  all  others. 


^'JTPTs  were  divided  into  sections  beised  on  heterogeneity  of  job  tasks 
within  a  specialty.  The  set  of  tasks  cornnon  to  an  entire  career  field  was 
referred  to  as  "Phase  I";  those  specific  to  workcenters,  MAJCXWs,  worksites,  and 
so  on,  were  labeled  as  "Phase  II."  Six  of  the  eight  WTPTs  consisted  of  a  two- 
phase  structure  while  the  AFS  423X5  was  a  single-phase  test.  The  WTPT  for  AFS 
426X2  required  a  three-phase  structure  to  account  for  unique  aspects  of  engine- 
type  and  worksite. 


^For  an  in-depth  discussion  of  the  development  of  all  instruments  see  Laue, 
et  al.  (1992). 
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AFS 


CALENDAR  YEAR 


426X2 

492X1 

272X0 

328X0 

423X6 

732X0 

122X0 

324X0 


•  JPMS  Development 


>  JPMS  Data  Collection 


Figure  1.  Timelines  for  JPMS  Development  and  Data  Collection. 


required  procedures.  The  entire  data  collection  effort  is  described  in  the 
following  three  chapters.  Chapter  II  addresses  those  activities  that  occurred 
prior  to  data  collection.  This  includes:  the  selection  of  data  collection  sites; 
the  selection,  training,  and  responsibilities  of  test  administrators  and 
proctors;  and  the  logistical  arrangements  that  occurred  prior  to  arriving  at  a 
data  collection  site. 

Chapter  III  describes  everythii^  that  occurred  between  arrival  at  and 
departure  from  each  data  collection  site.  Ihese  activities  include:  confirmation 
and  selection  of  participants;  in-briefings;  and  rater  training  and  project 
orientation  for  incumbents,  supervisors,  and  peers.  A  complete  description  is 
given  on  how  the  rating  forms,  questionnaires,  job  knowledge,  hands-on,  jpd 
interview  measures  were  administered  and  controlled.  The  chapter  concludes  with 
a  discussion  of  how  the  data  are  handled  after  collection. 
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A  sximary  of  procedxiral  modifications  made  from  one  data  collection  effort 
to  the  next  is  provided  in  Chapter  IV.  These  "lessons  learned"  are  discussed  and 
reconmendations  for  future  data  collection  efforts  are  made.  Concluding  corments 
are  made  in  Chapter  V. 


II.  ACTIVITIES  I^IOR  TO  DATA  a2LLBCTI0K 

As  Figure  2  depicts,  many  preparatory  activities  occurred  prior  to  arrival 
at  a  data  collection  site  (e.g. ,  selection  of  data  collection  sites,  and  training 
of  proctors^  and  test  administrators).  The  figure  also  indicates  that  these 
activities  occurred  simultaneously  with  the  final  stages  of  JPMS  development. 
The  following  will  describe  in  detcdl  these  preliminary  activities. 


Selection  of  Data  Collection  Sites 

Data  collection  site  selection  was  conducted  independently  for  each  AFS. 
AFS  functional  managers  at  the  three  primary  major  conmands  (MAJCCMs)  operating 
in  the  continental  United  States  [Military  Airlift  Ccnmand  (MAC),  Strategic  Air 
Cormand  (SAC),  and  Tactical  Air  Cormand  (TAC)]  identified  bases  for  data 
collection.  These  fimctional  managers,  typically  senior  Non-conmissioned 
Officers  (NCOs)  with  10  to  20  years  of  experience  in  an  AFS,  were  responsible  for 
monitoring  all  aspects  of  the  AFS  within  their  MAJCCMs,  including  manning, 
training,  and  equipment.  The  functional  managers,  along  with  more  senior-ranking 
managers,  had  been  briefed  at  the  onset  of  the  JEMS  development  process  and  had 
pledged  support  to  the  JPM  Project  goals  and  requirements.  They  identified 
locations  with  adequate  ntiribers  of  first-term  airmen  and  where  scheduled 
exercises  or  other  mission  requirements  would  not  preclude  data  collection. 

A  tentative  data  collection  plan  was  built  by  AFHRL  scientists  from  the 
inputs  of  each  MAJOQM.  This  plan  further  considered  the  number  of  airmen  at  each 
base,  the  bases'  major  operational  conmands  (to  insure  adequate  representation 
of  each  MAJCOM),  geographic  location,  and  availaibility  of  equipment  required  by 
the  data  collection  effort.  Proposed  schedules  of  bases  and  dates  were  submitted 
to  the  MAJCCMs  for  approval.  This  process  was  repeated  until  schedules  were 
derived  which  were  acceptable  to  the  MAJCCMs  and  would  allow  data  collection  to 
proceed  smoothly  with  effective  use  of  time  and  resources.  Table  2  lists  the 
nvmber  of  bases  visited  for  each  AFS  and  the  mean  nviriber  of  incunribents  tested  at 
each  base. 

Final  data  collection  schedules  were  released  via  electronic  message  to 
each  base  involved.  In  addition  to  a  testing  schedule,  these  messages  included 
an  agaida  for  tne  visit,  a  list  of  required  support,  and  a  request  for  the 
appointment  of  a  unit  Point-of -Contact  (POC) .  Arrangements  for  the  visit  were 


^Proctor  is  the  term  describing  the  person  assigned  as  data  collection  team 
leader.  Both  civilian  contractors  and  active-duty  enlisted  personnel 
successfully  performed  these  duties.  The  issues  surrounding  civilian  versus 
active-duty  personnel  are  discussed  in  Chapter  IV. 
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JPMS  DATA  COLLECTION 


Note.  The  dotted  lines  indicate  JPMS  development  activities  which  overlapped  the 
data  collection  activities. 


Figure  2.  JPMS  Data  Collection. 
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caipleted  via  telephone  conversatians  between  the  imit  PCX!  and  the  team  proctor. 
A  final  message  was  sent  to  the  \jnit  POCs  to  provide  data  collection  team  arrival 
dates,  names,  and  billeting  and  transportation  requirements. 


Selection  of  Proctors  and  Test  Adninistcators 

Data  collection  was  accomplished  by  teams  usually  consisting  of  one  proctor 
and  two  or  three  specialists  serving  as  test  administrators  (TAs)  each.  Table 
3  provides  a  breakdown  of  the  nunber  of  teams  and  their  members  for  each  AFS. 
Selection  of  proctors  and  TAs  was  a  primary  concern.  The  success  of  the  JPMS 
data  collection  efforts  and  the  quality  of  the  resulting  data  depended  on 
skillful  administration  of  JPMS  instnr«nts  and  the  smooth  c^ration  of  each 
team.  The  responsibilities  of  the  proctors  and  TAs  are  provided  in  Table  4. 
Definition  of  these  responsibilities  provided  the  criteria  used  to  select 
individuals  to  serve  as  proctors  and  Tfts. 

The  proctor  responsibilities  dictated  that  candidates  for  this  position 
possess  proven  leadership  and  administrative  capabilities,  as  well  as  good 
ccnnunication  and  interpersonal  skills.  It  wcts  preferable  that  proctors  possess 
technical  expertise  in  all  areas  covered  by  theNTPT,  but  this  was  not  required. 
Previous  exposure  to  the  JFM  project  was  also  beneficial,  though  not  required. 
Finally,  to  ensure  an  effective  line  of  authority  within  each  team,  active-duty 
military  proctors  at  the  rank  of  Master  Sergeant  or  above  were  preferred. 

Selection  criteria  for  TAs  were  similar  to  those  for  proctors.  TAs  were 
required  to  possess  good  interpersonal  and  ccmnuni cation  skills.  Technical 
expertise  in  all  areas  covered  by  the  WTPT  was  of  key  importance.  Previous 
exposure  to  the  JPM  project  again  was  desirable  but  not  mandatory.  The  rank  of 
active-duty  TAs  was  one  selection  criterion  for  two  reasons.  First,  it  was 
important  that  the  TA  rank  did  not  intimidate  the  incurbents  and  thereby  hamper 


Table  2.  Summary  of  Data  Collection  Sites 


AFS 

Nxxrber  of  Bases 
Visited 

Incurbents 
Tested  per  Base® 

423X5 

18 

15 

426X2 

13 

20 

429X1 

14 

11 

732X0 

19 

10 

122X0 

20 

10 

272X0 

16 

12 

324X0 

24 

8 

328X0 

18 

5 

^lean,  rounded  figure  of  incumbents  tested  at  each  base. 
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Table  3.  JFMS  Data  Collection  Teams 


AFS 

Team 

Nunrber  of 
Proctors 

Nuiber 
of  TAs 

426X2 

A 

3* 

B 

- 

3 

C 

- 

3 

492X1 

A 

1 

1 

B 

1 

2 

C 

1 

2 

272X0 

A 

1 

1 

B 

1 

2 

328X0 

A 

1 

2 

B 

1 

2 

C 

1 

2 

423X5 

A 

1 

2 

B 

1 

2 

C 

1 

2 

D 

1 

2 

732X0 

A 

1 

2 

B 

1 

2 

C 

1 

2 

D 

1 

2 

122X0 

A 

1 

2 

B 

1 

2 

C 

1 

2 

D 

1 

2 

E 

1 

1 

F 

1 

1 

324X0 

A 

1 

2 

B 

1 

2 

C 

1 

2 

D 

1 

2 

E 

1 

2 

F 

1 

1 

Total 

31 

28 

60 

'Teams  involved  in  the  data  collection  for  AFS  426X2  did 
not  have  proctors;  one  team  member  was  trained  to 
function  in  a  dual  role  of  TVteam  leader. 
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Table  4.  JFMS  Team  Roles  and  Responsibilities 


TEAM  TOCTCR 

1.  Provide  team  leadership  to  facilitate  effective  operation  and  the 
collection  of  quality  data. 

2.  Serve  as  the  liaison  between  team  and  AFllRL/ contractor  project 
personnel . 

3 .  Serve  as  team  spokesperson  to  base  personnel . 

4.  Transport  and  store  controlled  tests  and  other  JPMS  data  collection 
materials. 

5.  Verify  eligibility  of  incixibents,  supervisors,  and  peers. 

6.  Conduct  rating  form  and  job  knowledge  test  administration  sessions. 

7.  Conduct  shadow  scoring  exercises.^ 

8.  Resolve  technical  disputes  among  TAs. 

9.  Make  travel,  lodging,  and  transportation  arrangements  for  the  team. 

10.  Prepare  data  collection  documentation  and  r^orts. 

11.  Forward/deliver  data  and  materials  to  the  AEMRL. 

TEST  AEMINlSIRKrOR 

1.  Effectively  function  as  a  member  of  a  team  to  ensure  the  collection  of 
quality  data. 

2 .  Make  appropriate  WTPT  administration  preparations ,  including  setting  up 
required  equipment,  and  locating  necest,ary  TOs  and  expendable  siipplies. 

3.  Administer  the  WTPT  and  the  JPMS  Questionnaire. 

4.  Transfer  test  and  questionnaire  responses  to  scan  sheets. 

5.  Participate  in  shadow  scoring  exercises.^ 


^Shadow  scoring  is  a  method  of  WTPT  adninistration  whereby  two  TAs 
simultaneously  observe  and  evaluate  task  performance.  Shadow  scoring  is 
discussed  in  greater  detail  in  Chapter  III. 
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test  performance;  it  was  also  inportant  to  insure  that  TAs  had  current  knowledge 
of  actual  day-to-day  perfornance  of  first- term  airmen  tasks.  For  these  reasons, 
TIks  were  required  to  be  at  either  the  Technical  Sergeant,  Staff  Sergeant,  or 
Sergeant  level. 


Proctor  and  Test  Administrator  Training 

Proctors  aiKl  TAs  were  trained  by  contractor  trainers  during  two-week 
workshops  conducted  prior  to  the  data  collection  efforts.  Some  training 
activities  were  conducted  simultaneously  for  both  proctors  and  TAs.  The  JFMS 
orientation  briefing,  for  exanple,  was  presented  to  the  entire  group  since  all 
members  of  a  data  collection  team  needed  to  be  educated  on  the  background  and 
objectives  of  the  JFM  project  and  the  components  of  the  JFMS.  However,  the 
content  of  most  training  activities  were  specific  to  proctor  or  TA  job 
requirements  and/or  to  an  AFS  and,  therefore,  dictated  separate  training 
programs . 

Proctor  training  addressed  the  following  general  areas  of  responsibility: 
(a)  conduct  of  briefings;  (b)  conduct  of  rater  training  sessions;  (c) 
administration  of  rating  forms,  questionnaires,  and  paper-and-pencil  tests;  (d) 
completion  of  rating  form  answer  sheets;  (e)  facilitation  of  shadow  scoring 
exercises;  (f)  logistical  planning;  and  (g)  documentation  of  data  collection 
activities.  In  addition,  proctors  were  familiarized  with  the  content  and  testing 
requirements  of  the  WTPT. 

The  content  of  test  administrator  training  focused  almost  exclusively  on 
procedures  necessary  for  administration  of  the  HTFT,  including  the  development 
of  accurate,  consistent,  and  standardized  observation  skills.  TAs  were  also 
trained  to  transfer  test  data  to  WTPT  answer  sheets  and  to  perform  effectively 
the  steps  necessary  to  prepare  a  testing  site  for  WTPT  administration.  Training 
activities  for  the  initial  data  collection  effort  (AFS  426X2)  are  described  in 
Bierstedt  and  Hedge  (1987).  Once  all  training  and  logistical  requirements  were 
met,  the  JPMS  administration  began. 


III.  ON-SITE  DAIA  OXJ^CrriON  ACTIVITIES 
Overview 

The  ideal  schedule  for  JFMS  administration  at  a  data  collection  site  is 
outlined  in  Figure  3.  The  average  time  spent  at  each  site  was  two  weeks.  The 
same  procedures  were  followed  at  each  testing  site  (as  depicted  in  Figure  2). 
A  test  site  visit  began  with  in-briefings  or  courtesy  calls  and  finalization  of 
session  attendance  schedules.  The  four-hour  rating  form  session  followed,  and 
included  an  introductory  briefing,  rater  training  session,  and  completion  of 
rating  forms  and  questionnaires.  Simultaneously,  the  TAs  set  up  the  equipment 
at  the  WTPT  achidnistration  location.  The  four-hour  job  knowledge  testing  session 
was  conducted  on  the  second  day.  If  additional  rating  form  sessions  were 
required,  they  were  scheduled  after  ccnpletion  of  the  initial  job  knowledge 
testing  session.  In  this  way,  a  group  of  incvmbents  could  complete  the  rater 
training  and  job  knowledge  testing  sessions  and  be  ready  for  WTPT  administration. 
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when  an  incumbent  had  conpleted  all  rating  forms,  questionnaires,  and 
knowledge  tests,  the  WTPT  was  administered.*  Upon  ccnpletion  of  the  WTPT,  the 
incunnbent  completed  the  JEMS  Questionnaire.  This  concluded  the  testing  for  an 
individual;  WTPT  administration  continued  until  all  incurfcents  were  tested.  An 
out -briefing  was  then  provided  for  host  officials  and  the  collected  data  were 
packaged  and  nailed  to  the  AFHRL. 

The  following  sections  describe  in  detadl  these  on-site  data  collection 
activities.  A  brief  description  of  each  test  instrunent  included  in  the  JEMS  is 
also  provided. 


Arrival  at  Test  Site 

The  data  collection  team  arrived  at  the  test  site  at  least  one  day  prior 
to  the  first  day  of  data  collection  to  allow  for  the  completion  of  billeting  and 
rental  car  or  base  vehicle  transportation  arranganents .  In  addition,  proctors 
contacted  base  POCs  xjqKin  arrival  at  the  site  to  finalize  the  testing  schedule. 
If  carrying  controlled  tests  (e.g..  Apprentice  Knowledge  Test),  the  proctors 
delivered  them  to  the  test  control  officer  for  secure  storage.  Team  members 
communicated  with  the  AETIRL  on  a  weekly  basis  and  vAienever  questions  or  problems 
arose.  Weekly  contact  usually  occurred  xipan  arrival  at  a  new  test  site  to  report 
on  events  which  occurred  at  the  previous  test  site  and  to  communicate  the  testing 
schedule  at  the  current  site. 


In-Briefings  and  Scheduling 

The  data  collection  procedure  commenced  with  in-briefings  and  finalization 
of  the  schedule  (see  Figure  3).  In-briefings  were  conducted  at  the  request  of 
host  unit  officials.  Briefing  audiences  ranged  from  shop/section  chiefs  through 
Deputy  Commanders  (E-6  through  0-6).  Although  the  briefings  were  prepared  and 
rehearsed  as  formal  presentations  with  overhead  transparencies,  most  briefings 
were  conducted  informally  without  visual  aids.  These  briefings  provided 
information  to  management  regarding  the  purpose  of  the  research  project,  the 
potential  mission  impact,  and  how  this  impact  would  be  ndnimized. 

As  discussed  earlier,  the  initial  request  for  unit  support,  which  included 
a  description  of  requested  participants,  was  conducted  by  way  of  message.  The 
pre-visit  message  and  telephone  contact  with  the  FOC  at  each  site  were  not  always 
successful  in  completely  conveying  the  p\irpose  and  requirements  of  the  project. 
Thus,  it  was  important  that  the  first  morning  of  a  site  visit  be  used  to  finalize 
the  testing  schedule  and  ensure  that  the  selected  incvnbents,  supervisors,  and 
peers  met  operational  definition  requirements,  described  in  detail  below. 


H^en  the  WTPT  required  only  four  hours  for  completion  (i.e.,  APS  272X0, 
AFS  492X1,  and  AFS  732X0),  two  tests  could  be  administered  each  day  by  each  TA. 
In  all  other  AFSs,  only  one  WTPT  was  administered  by  each  TA  during  an  eight -hour 
shift. 
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DAY 


AM 


PM 


1 


In-Briefing 

Verification  of 

(Proctor) 

Schedule  and  Participants 

(Proctor) 

Rating  Form  Session  (Proctor) 


WTPT  Equipment  Set-up  (TAs) 


Job  Knowledge  Testing  Session  (Proctor) 

Additional  Rating  Form  or 

JKT  Sessions  (as  needed  -  Proctor) 

Shadow  Scored  WTPT  Administration  (Proctor  and  TAa) 

Discussion 
(Proctor 
and  TAs) 

WTPT  Administration  (TAs) 

Additional  Rating  Form  or  JKT  Sessions  (as  needed  -  Proctor) 
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WTPT  Administration  (TAa) 


Out-briefing  (Proctor) 


Packaging  and  Mailing  Materials  (Proctor) 


Figure  3.  Typical  On-site  Data  Ctol lection  Schedule. 
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The  majority  of  incutfcents  selected  to  participate  were  first-term  airmen 
with  6  to  48  months  Total  Active  Federal  Military  Service  (TAEMS).  These  limits 
ensured  that  incumbents  had  carpleted  required  technical  training  and  hzui  been 
performing  on  the  job  for  a  sufficient  amount  of  time  to  warrant  taking  the 
WTPT.‘ 


Each  supervisory  participant  selected  to  serve  as  a  rater  had  to  be  a 
direct  supervisor  of  the  inoinbent  with  first-hand  knowledge  of  his/her 
proficiency.  The  supervisor  was  ideally  the  person  who  conpleted  the  incmibent's 
Airmen  Performance  Report  on  a  regular  basis,  and  should  have  supervised  and 
observed  to  performance  of  the  incvirbent  for  a  mininun  of  three  months.  A 
stq>ervisor  was  allowed  to  rate  more  than  one  incunnbent,  but  it  was  important  to 
ensure  that  s\;^rvisors  did  not  rate  an  excessive  nunber  of  individuals.  Fatigue 
caused  by  rating  too  many  incmbents  could  have  potentially  resulted  in 
inaccurate  ratings.  The  exact  nixiber  of  incvxnbents  rated  by  one  supervisor  was 
decided  by  the  proctor  on  a  case  by  case  basis,  usually  not  to  exceed  three. 

It  was  requested  in  the  pre-visit  message  that  three  peers  be  identified 
for  each  incurrbent.  A  peer  was  defined  as  a  member  from  the  same  AFS  who  had 
worked  with  the  incunbent  for  at  least  three  months,  the  peers  had  to  have 
previously  observed  the  performance  of  the  incunbent.  As  with  the  si;qpervisors , 
an  individual  could  serve  as  peer  to  more  than  one  incunbent,  provided  that 
caution  was  taken  to  ensure  that  the  nunber  of  incunbents  to  be  rated  by  a  peer 
was  reasonable.  Also,  incunbents  could  serve  as  peers  for  other  incunbents.  It 
is  important  to  note  that  many  specialties  and  job  sites  were  structured  such 
that  it  was  often  very  difficult,  if  not  ini>ossible,  to  obtain  three  peers  per 
incunbent.  In  these  cases  it  was  acceptable  to  gather  ratings  from  only  two 
peers. 


All  of  the  above  criteria  were  guidelines  for  selection  of  raters,  but  it 
was  often  necessary  to  make  decisions  while  in  the  field  which  did  not  meet  these 
guidelines.  Such  deviations  from  the  rules  were  made  with  caution,  and  final 
decisions  were  reached  only  after  discussion  with  the  AFURL  or  contractor 
researchers.  The  Data  Collection  Schedule  Form  was  completed  after  this  final 
verification  of  participants.  The  form  is  provided  in  Appendix  A  as  part  of  the 
Trip  Report  Package.  All  deviations  were  noted  by  the  proctor  in  the  trip 
report . 


Rating  Form  Session 

The  first  afternoon  at  a  test  site  was  devoted  to  the  rating  form  session 
(see  Figure  3) .  Sessions  were  conducted  in  a  quiet  classroom  atmosphere  whenever 


^The  cut-off  was  extended  for  AFS  328X0  to  include  incunbents  with  up  to 
60  months  TAEMS  in  order  to  obtain  a  sufficient  sample  size. 
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possible,  althov^h  breakroom  areas  were  sometimes  used.'  'Hie  requirements  for 
rating  form  sessicoi  location  (and  the  subsequent  JKT  session)  were  a  well-lighted 
room  with  sufficient  table  space  for  privacy  diuring  conrpletion  of  the  ratings  or 
tests. 

Prior  to  each  rating  session,  the  proctors  conpleted  portions  of  the  rating 
fomv'questionnaire  answer  sheet  (Appendix  B)  including  the  name  of  the  person  to 
be  rated,  the  name  of  the  rater,  rater's  skill  level,  rating  source  (i.e.,  self, 
supervisor,  or  peer),  and  date.  In  addition,  base,  proctor,  AFS,  and  phase  codes 
were  recorded  on  eac^  answer  sheet  (Appendix  C).  This  preparation  facilitated 
the  activities  during  the  rating  form  session. 

During  the  rating  form  session,  incumbents,  supervisors,  and  peers  received 
an  introductory  briefing  and  rater  training.  Participants  then  completed  the 
required  rating  forms  and  a  series  of  questionnaires.  The  following  sections 
describe  the  basic  components  of  a  rating  form  session,  as  well  as  the  various 
rating  forms.  For  a  detailed  description  of  the  content  and  purpose  of  the  rater 
training,  see  Bierstedt  and  Hedge  (1987). 


Introductory  Briefing 

The  introductory  briefing  explained  the  purpose  of  the  project  and  what  was 
requested  of  each  participant.  The  briefing  text  and  slides  are  provided  in 
Appendix  D.  After  the  briefing  was  conducted  and  all  questions  of  a  general 
nature  were  answered,  a  Rater  Training  Session  Sign-In  Sheet  was  circulated  to 
record  attendance  (Acpendix  A) .  These  briefing  slides  were  also  used  when  formal 
in-briefings  were  requested  by  host  unit  officials. 


Rater  Training 

Rater  training  was  designed  to:  (a)  familiarize  raters  with  the  four  rating 
forms  and  the  three  questionnaires,  (b)  educate  the  raters  on  how  to  make 
accurate  ratings,  and  (c)  provide  an  opportunity  for  practice  and  feedback.  Each 
rater  was  provided  with  a  reusable  booklet  containing  the  training  exercises,  the 
four  rating  forms,  and  the  three  questionnaires.  The  training  session  was 
conducted  in  a  lecture  format  with  overhead  transparencies  as  learning  aids,  and 
provided  opportunities  for  group  participation  and  discussion.  Rater  traiiung 
sessions  were  adapted  for  each  AFS  because  some  rating  form  and  questionnaire 
content  was  AFS-specific  (e.g. ,  Task  Rating  Form,  Task  Experience  Questionnaire) 
and  examples  used  during  the  rater  training  session  came  directly  from  these 
instnxnents.  'Hie  script  used  to  conduct  the  rater  training  session  for  AFS  122X0 
is  included  as  an  example  in  Appendix  D.  After  rater  training,  the  proctor 
distributed  the  computer  scan  answer  sheets  for  recording  rating  form  and 


^It  was  best  to  have  all  involved  (i.e.,  incvnbents,  supervisors,  peers) 
participate  in  a  single  rating  form  session  to  limit  the  amount  of  disturbance 
to  the  unit's  mission.  In  most  cases,  however,  more  than  one  session  was 
required. 
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questicnnaire  responses .  A  brief  training  session  was  then  conducted  on  the  use 
of  these  answer  sheets. 


Conpletion  of  Rating  Forms 

Four  rating  forms  were  conpleted  by  each  participant  for  each  incunnbent 
rated.  Raters  were  instructed  to  complete  all  rating  forms  for  the  first 
incvnbent  before  rating  a  second  incurbent.  It  was  emphasized  that  attention 
should  be  focused  only  on  the  person  being  rated,  avoiding  comparison  with  other 
workers. 

The  rating  form  booklet  for  AFS  122X0  TAC  is  provided  in  Appendix  E  as  an 
example.  Each  booklet  contained  both  the  four  rating  forms  and  the  three 
questionnaires.  The  rating  forms  were  completed  in  the  following  order: 

Global  Rating  Form.  The  Global  Rating  Form  was  developed  to  collect 
overall  ratings  of  job  proficiency.  Ratings  were  made  on  two  items:  (a) 
technical  proficiency,  and  (b)  interpersonal  proficiency.  These  forms  were 
designed  to  be  used  for  all  specialties  with  only  minor  terminology  changes 
required  for  describing  performance  levels  corresponding  to  the  five  points  on 
the  rating  scale.  The  same  Global  Rating  Form  was  used  for  all  phases  within  an 
AFS. 


Dimensional  Rating  Form.  The  Dimensional  Rating  Form  evaluated  overall 
levels  of  proficiency  on  several  dimensions  defined  by  groups  of  tasks. 
Dimensions  were  identified  through  factor  aiuilysis  of  occupational  survey  data 
and  verified  by  AFS  Subject  Matter  Experts  (SMEs).  The  nutiber  of  dimensions 
ranged  from  four  to  nine  across  AFSs.  Specialty-specific  behavioral  descriptions 
were  included  for  the  five  scalar  values  for  each  dimension.  The  same 
Dimensional  Rating  Form  was  used  for  all  phases  within  an  AFS. 

Task  Rating  Form.  The  Task  Ratiiig  Form  collected  the  most  specific 
evaluation  data.  Raters  were  required  to  rate  an  incumbent's  proficiency  on  a 
list  of  tasks  including  those  in  the  HTPT  and  others  representative  of  job 
content  domain.  Tasks  were  rated  using  a  5-point  adjectivally-anchored  rating 
scale.  The  nvzrber  of  tasks  on  the  rating  forme  varied  frcmi  19  to  40  across  AFSs 
and  phases  within  an  AFS. 

In  soma  cases,  raters  encountered  tasks  or  dimensions  vduch  they  had  not 
performed,  or  seen  the  incumbent  perform.  When  this  occurred,  raters  were 
instructed  to  base  their  ratings  on  behavior  they  had  observed  on  related  tasks. 

Air  Force-wide  Rating  Form.  The  Air  Force-wide  Rating  Form  was  developed 
to  collect  ratings  on  characteristics  related  to  overall  success  in  the  Air 
Force.  Eight  general  factors  were  rated  using  a  5-point  adjectivally-anchored 
scale,  with  behavioral  descriptions  applicable  to  all  specialties.  The  same  Air 
Force-wide  Rating  Form  was  used  across  all  phases  and  all  eight  AFSs. 
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Ocnpletion  of  Questicimaires 

Two  questionnaires  administered  during  the  rating  form  session  gathered 
background  and  attitude  data;  a  third  gathered  incunnbent  experience  data. 
Responses  to  all  three  questionnaires  were  recorded  on  the  rating  form  answer 
sheet.  These  questionnaires  were  conpleted  only  once  by  each  rater.  Raters  of 
nultiple  incumbents  recorded  their  questionnaire  responses  on  the  first  rating 
form  answer  sheet  completed.  Incixrbents  recorded  questionnaire  responses  on 
their  self  rating  form  answer  sheets.  Samples  of  these  three  questionnaires  are 
included  with  the  rating  forms  in  Appendix  E. 

General  Background  Questionnaire.  The  General  Background  Questionnaire 
gathered  information  about  the  rater,  including:  (a)  time  in  Service,  (b)  time 
in  unit,  (c)  time  on  present  job,  (d)  situational  constraints  experienced  on  the 
job,  and  (e)  motivation  toward  the  job.  Questions  concerning  time  in  service, 
unit,  and  present  job  were  open-ended;  respooises  were  recorded  on  an  extra  copy 
of  the  first  page  of  the  General  Background  Questionnaire.  The  proctor  ensured 
that  these  questions  were  answered  on  the  supplemental  sheet  and  remaining 
multiple-choice  question  responses  were  recorded  in  the  correctly  numbered  places 
on  the  answer  sheet.  The  General  Badcgrovmd  Questionnaire  differed  across 
specialties  only  on  job  experience  questions,  which  reflected  the  structure  and 
terminology  of  the  career  field. 

Rating  Form  Questionnaire.  This  questionnaire  collected  feedback  from  the 
raters  on  form  acceptability,  rating  accuracy,  ease  of  rating  form  use,  and 
general  opinions  about  the  form  characteristics.  This  form  was  the  same  across 
AFSs. 


A  problem  frequently  encountered  with  the  Rating  Form  Questionnaire  was  a 
shift  in  response  format.  Ratings  on  5-point  scales  were  used  for  the  topics 
described  above;  ranking  of  form  preference  on  a  nvnber  of  the  same  topics  was 
also  included.  Regardless  of  the  verbal  and  written  instructions  provided,  the 
transition  was  usvially  overlooked  by  at  least  one  participant  per  rating  form 
session.  As  a  result,  the  proctor  specifically  checked  this  block  on  the  answer 
sheet  for  accuracy. 

Task  Experience  Questionnaire.  The  Task  Experience  Questionnaire  collected 
information  on  the  incurbent's  relevant  on-the-job  experience  on  tasks 
representative  of  the  job  content  domain.  This  form  was  completed  only  by  the 
WTPT  incuTibents.  Ratings  were  made  using  a  5-point  adjectivally  anchored  scale. 
This  questionnaire  was  specific  to  each  phase  within  an  AFS,  paralleling  the 
content  of  the  Task  Rating  Form. 


HTFT  Equipment  Set-f^ 

As  Figiure  3  depicts,  on  the  first  day  at  a  test  site,  the  TAs  were 
responsible  for  choosing  a  location  for  WTFT  aubninistration,  setting  xip 
equipmoit,  and  ensuring  the  availability  of  all  testing  materials.  The  WTPT  was 
administered  at  the  job  site  to  ensure  the  presence  of  equipment  and 
environmental  cues  during  test  performance.  If  on-site  testing  (i.e.,  in  the 
immediate  work  vicinity)  was  impossible  due  to  safety,  standardization,  or 
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extretne  distraction  factors,  an  alternate  location  was  chosen.  Decisions 
concerning  replacement  materials  or  alternate  testing  locations  were  mde  in 
conjunction  with  the  AFHRL  or  contractor  researchers. 


Job  Raowledge  Testing  Session 

The  second  day  at  a  testing  site  typically  began  with  the  Job  Knowledge 
Testing  (JKT)  session  (see  Figure  3).  Ihese  paper-and-pencil  measures  were 
included  in  the  JPMS  only  during  the  third  data  collection  effort.  The  JKT 
session  took  four  hours  and  was  usiially  conducted  in  the  same  room  as  the  rating 
form  session.  A  knowledge  test  sign-in  sheet  (Appeiridix  A)  was  completed  for 
every  session. 

The  first  test  administered  was  a  specialty-specific  JKT  which  had  been 
developed  for  the  JFM  Project  in  parallel  with  the  WTPT,  covering  the  same  tasks 
measured  by  the  MTPT.  The  mirber  of  multiple-choice  items  xranged  from  87  to  159 
across  AFSs.  The  nurber  of  items  within  AFSs  also  varied  as  a  result  of 
corresponding  WTPT  phase  differences.  The  proctor  ensured  that  each  incurbent 
completed  the  Phase  I  portion  of  the  JKT,  as  well  as  the  appropriate  Phase  II 
portion.  Two  hours,  with  one  break  period,  were  allowed  for  conpletion  of  the 
JKT.  The  instructions  for  administraticai,  an  Air  Force  Type  C  answer  sheet  used 
for  recording  responses,  and  a  sanple  from  the  APS  122X0  JKT  are  included  in 
Appendix  F. 

After  completion  of  the  JKT,  incumbents  were  allowed  a  short  break  and  were 
then  administered  the  Apprentice  Knowledge  Test  (ART).  The  ART,  a  100-it«n, 
multiple-choice  test,  was  admiiustered  in  a  two-hour  period,  as  specified  by  AF 
Regulations.  The  Space  Perception  Test  (SPT),'  a  20  item,  multiple-choice  test 
with  a  12-minute  time  limit,  was  given  following  the  AKT  administration.  The  ART 
and  SPT  both  required  appropriate  Air  Force  test  control  measures. 

It  was  quite  common  for  incuibents,  supervisors,  or  peers  to  miss  the  first 
rating  form  and/or  JKT  administration  session.  Thus,  rating  form  sessions  and 
job  knowledge  testing  continued  through  the  first  week  until  all  participants  had 
attended.  In  every  case,  an  incunbent  had  to  attend  a  rating  form  and  JKT 
sessiai  before  taking  the  WTPT. 


WIPT  Adidnistraticn 

The  WTPT  was  designed  to  measure  job  proficiency  of  first-term  career  field 
members  on  a  representative  sample  of  job  tasks.  The  general  directions  followed 
by  the  TA  during  administration  are  provided  in  Appendix  G.  Some  WTPT  items 
required  hands-on  performance  while  others  were  developed  as  interviews.  For 


^The  SPT  was  adninistered  to  incunbents  in  the  second  data  collection 
project  where  it  was  adninistered  inmediately  after  the  WTPT.  The  SPT  is 
considered  to  be  an  aptitude  test,  not  a  performance  measure,  and  data  were 
collected  to  assess  whether  the  SPT  should  be  included  in  the  ASVAB. 
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some  tasks,  both  hands-on  and  interview  items  were  developed  and  referred  to  as 
"overlap  items."  Examples  of  AFS  122X0  interview  and  hands-on  items  are  provided 
in  Appendix  H. 

TAs  were  provided  with  a  standard  schedule  for  sequencing  the 
administration  of  test  items  to  optimize  use  of  equipment  involved.  Schedules 
typically  organized  tasks  into  modular  units  based  on  how  tasks  were  logically 
performed  on  the  job.  The  test  schedule  took  into  account  time  limitations  of 
the  test,  shift  rotations  of  personnel ,  and  accessibility  to  the  appropriate  work 
places.  When  more  than  one  WTPT  administration  occurred  simultaneously  at  a 
site,  the  testing  schedule  of  the  TAs  was  adjusted  so  conflict  on  use  of 
equipment  would  not  occur. 

Before  beginning  the  WTPT  administration,  a  sanvle  interview  item  was 
administered  vduch  familiarized  the  incunnbent  with  the  testing  procedure. 
Testing  then  began  with  the  TA  directing  the  incunnbent  to  the  correct  page  in  the 
incunnbent 's  manual  (Appendix  I),  and  reading  the  objective  for  the  first  task 
aloud  while  the  incurrbent  read  along  silently.  At  the  beginning  of  each  task  the 
TA  asked  how  often  the  incunnbent  had  performed  the  task  and  how  many  weeks  had 
passed  since  the  last  time  it  had  been  performed.  This  information  was  recorded 
in  the  administrator's  book.  The  task  instructions  were  then  read  aloud  while 
the  incumbent  followed  along  in  the  incunbent  manual.  The  incunnbent  was  allowed 
time  to  gather  the  required  tools,  materials,  and/or  technical  documents;  timing 
of  task  performance  began  after  materials  had  been  gathered. 

The  TA  observed  performance  on  the  hands-on  tasks  and  marked  either  a  "Yes" 
or  "lio"  for  each  step  in  the  WTPT  administrator's  book.  If  the  step  was 
performed  correctly  the  TA  would  mark  "Yes."  If  the  step  was  performed,  but  done 
incorrectly,  or  if  the  step  was  not  performed,  the  TA  marked  "No."  After  the 
specifics  of  a  hands-on  WTPT  task  had  been  explained,  the  TA  primarily  observed 
and  recorded  task  performance;  direct  questioning  by  the  TA  was  not  allowed 
unless  specifically  designated  in  an  item. 

TAs  administered  interview  items  in  a  similar  manner,  recording  the 
step-level  completion/ correctness  of  responses.  The  incumbent  was  requested  to 
describe  all  required  steps  in  a  task.  The  TA  was  not  allowed  to  assunne  or  infer 
that  an  incunbent  knew  how  something  was  to  be  performed.  The  TAs  were  patient 
and  allowed  sufficient  time  for  an  incunbent  to  answer.  All  trauisitional 
statements  were  neutral,  not  suggestive.  Probing  techniques  were  utilized  to 
gather  more  information  if  a  response  was  incomplete.  If  the  test  administrator 
was  unsure  of  how  to  evaluate  a  response,  the  actual  response  was  recorded  for 
evaluation  at  a  later  time. 

Established  time  limits  for  each  task  were  strictly  adhered  to;  if  a  task 
was  not  completed  within  the  specified  time,  the  incunbent  was  stopped  and  guided 
to  the  next  task.  Task  completion  time  was  recorded  in  the  administrator's  book. 
Upon  completicxi  of  each  task,  the  TA  gave  an  Overall  Performance  Rating  (OPR). 
The  OPR  was  a  5-point  adjectivally  anchored  rating  scale  ranging  from  1  ("Far 
below  the  acceptable  level  of  proficiency")  to  5  ("Far  exceeds  the  acceptable 
level  of  proficiency").  Examples  of  the  OPR  can  be  found  at  the  end  of  each  task 
in  Appendix  H. 
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The  pages  of  the  WTFT  administrator's  book  were  enclosed  in  clear  plaistic 
sheets;  erasable  grease  pencils  or  water-based  ink  pens  were  vised  to  record 
evalviations  on  these  sheets.  The  TAs  transferred  their  evaluaticxis  to  the 
optical  scan  WTPT  answer  sheet  (Appendix  J)  and  cleaned  the  TA  book  pages 
following  each  evalijation.  Each  WTPT  task  was  assigned  an  answer  sheet  task 
nvmber  and  performance  was  coded  into  the  appropriate  block.  WTPTs  consisting 
of  more  than  25  tasks  required  two  answer  sheets  to  record  the  entire  test 
performance. 


Shadow  Scoring 

Inter-rater  reliability  data  were  collected  through  a  dual  administration 
technique  called  "shadow  scoring."  Shadow  scoring  required  oneTA  to  conduct  the 
WTPT  administration  and  evaluation,  a  second  TA  to  observe  the  incnnbent  and 
independently  evaluate  performance,  and  the  proctor  to  observe  bothTAs  to  ensure 
that  they  were  independently  evaluating  the  incunbent.  This  process  vbs 
conducted  at  least  once  at  each  data  collection  site,  usually  during  the  first 
WTPT  administration  (see  Figure  3). 

After  completion  of  the  shadow-scored  WTPT  administration,  the  two  TAs 
transferred  their  evaluations  onto  their  respective  answer  sheets.  The  proctor 
then  moderated  a  discussion  between  the  two  TAs  directed  toward  inconsistencies 
in  scoring.  In  addition  to  providing  reliability  data,  this  procedure  also 
ensured  that  TAs  maintained  correct  procedures  and  standards  throughout  data 
collection.  The  TAs  discussed  why  their  evaluations  were  different  and  how  the 
taisk  or  step  should  be  rated.  If  the  test  administrators  could  not  agree,  the 
proctor  forced  a  resolution  using  the  two  TAs'  input. 

The  team  was  not  allowed  to  change  the  WTPT  administration  procedures  as 
part  of  the  resolution,  nor  were  they  allowed  to  alter  their  original 
evaluations.  Whereas  discussion  was  required  on  all  tasks;  docvxnentation  of  the 
discussion  and  resolution  was  required  only  when  there  were  two  or  more 
differences  in  step-level  evaluatiorvs  or  discrepancies  greater  than  one  point  in 
the  OPR.  This  procedure  was  followed  to  insure  consistency  in  future  instances 
where  the  same  or  similar  behaviors,  responses,  or  situations  occurred.  This 
documentation  form  is  provided  in  Appendix  A. 

If  TAs  recorded  considerably  different  responses,  the  shadow  scoring 
procedvure  was  followed  on  a  second  incvntient  to  detetmine  whether  improvement 
resulted  from  the  shadow  scoring  discussion.  If  differences  between  TAs  were 
minimal ,  shadow  scoring  sessions  were  performed  on  an  as  needed  basis  throughout 
data  collection  and  decisions  about  discontinuation  were  made  by  the  proctor 
after  consulting  with  the  AEURL  and  contractor  researchers. 
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JIMS  QuesticDoaire 

The  JIMS  Quest! Gnnai re’  was  administered  to  incurbents  after  conpleticn 
of  the  NTFT  (Appendix  K. )  Incurbents  assigned  ratings  on  a  5-point 
adjectival ly-ancbored  scale  to  various  statements  concerning  the  accuracy, 
acceptability,  and  clarity  of  the  instructions  for  each  JFMS  instnxnoit. 
Finally,  the  questionnaire  asked  the  incixibent  to  rank  the  rating  forms,  hands-on 
tests,  interview  tests,  and  job  knowledge  tests  (where  appropriate)  on  each 
instnment's  ability  to  provide  accurate  and  useful  information  about  an 
individual's  performance.  The  TAs  checked  the  questionnaire  before  dismissing 
the  incixnbent  to  ensiure  that  the  correct  response  format  was  used  (i.e. ,  ratings 
versus  rankings).  The  incumbent  recorded  responses  directly  on  the 
questionnaire;  the  TAs  transferred  this  information  to  the  WTFT  answer  sheet 
(Appendix  J).^' 

For  an  individual ,  this  was  the  final  step  in  the  testing  process .  After 
completion  of  the  MTPT  and  JFMS  Questionnaire,  incunnbents  were  thanked  for  their 
cooperation  and  requested  to  keep  all  details  confidential  to  allow  all  examinees 
the  same  opportunity  on  the  WTPT.  Administration  of  the  WTPT  continued  until 
each  incixibent  had  been  tested  as  scheduled. 


Out-Briefing  and  Conpletion  of  Forms 

When  data  collection  was  completed  at  a  site,  proctors  provided  out- 
briefings  for  the  host  unit  or  base-level  officials  upon  request  (see  Figvire  3). 
This  briefing  was  usually  an  informal  notification  that  data  collection 
procedures  were  successfully  comoleted  at  the  particular  site.  The  proctor  and 
TAs  were  not  allowed  to  provide  anyone  with  res'^lts  or  information  about  how 
particular  incvxrbents,  or  the  group  as  a  whole,  had  performed.  Also,  compa.isons 
to  other  bases  were  not  allowed. 

The  large  amounts  of  data  gathered  for  the  JFMS  demanded  organized  efforts 
to  account  carefully  for  all  testing  materials  and  data  sheets.  One  of  the  most 
inportant  organizational  efforts  was  the  preparation  of  on-site  records  and 
reports  used  to  document  data  collection  progress.  In  addition  to  the  forms 
described  thus  far,  both  TAs  and  proctors  completed  a  Comments  and 
Reconmendations  Form  (see  Appendix  A).  On  this  form,  proccors  and  TAs  were 
encouraged  to  docunnent  unusual  occurrences  and  make  suggestions  about  the  data 


Hie  JFMS  Questionnaire  was  call  the  "General  Utility/  Acceptability 
Questionnaire"  during  the  first  data  collection  effort  and  the  'VTPT 
Questionnaire"  during  the  second  data  collection  effort.  Job  Knowledge  Tests 
were  not  included  until  the  third  data  collection  effort,  hence,  the  two  earlier 
questionnaires  did  not  include  any  mention  of  these. 


^^Two  optical  scan  answer  sheets  were  completed  for  shadow  scored 
inevirbents.  The  JFMS  Questionnaire  responses  were  recorded  only  on  the  answer 
sheet  completed  by  tl<  ^  TA  who  conducted  the  test  adnninistration. 
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collecticsi  process.  The  proctors  also  conpleted  a  Data  Collection  Trip  Sumary 
vMch  was  attached  along  with  all  other  forms  to  the  Data  Collection  Trip  Report 
(Appendix  A).  With  all  forms  and  answer  sheets  conpleted  and  conpiled,  the  data 
sheets  were  forwarded  to  AEWRL  as  described  in  the  next  section. 


Delivery  of  Data 

The  mode  of  forwarding  conpleted  data  packages  to  AEURL  depended  on  the 
data  collection  schedule.  If  the  data  collection  teams  were  scheduled  to  return 
to  Brooks  AFB,  TX  diuring  data  collection,  materials  and  reports  were 
hand-delivered  to  the  AFHRL.  However,  if  the  teams  were  required  to  travel  to 
their  data  collection  sites  in  succession  without  returning  to  the  AFHRL,  nailing 
of  materials  was  the  most  efficient  procedure  in  terms  of  time,  travel,  and  cost 
(see  Figure  3).  Proctors  were  provided  /tith  information  regarding  Air  Force 
regulations  pertaining  to  use  of  the  mai^  system  so  they  could  correctly  convey 
these  requirements  to  the  appropriate  offices  at  each  test  site. 

As  Figure  2  indicates,  travel  to  the  next  test  site  followed  delivery  of 
data  to  AFHRL.  The  JFMS  data  collection  process  then  began  again.  This 
procedvire  continued  mtil  all  scheduled  sites  were  visited.  Team  members  then 
turned  all  data  collection  materials  over  to  the  AFHRL  aixi  returned  home. 


Oonpilation  of  Data  at  AFHRL 

Data  collection  packages  received  by  the  AFHRL  were  inventoried  and  logged 
to  ensure  that  all  required  instnxnents  and  materials  were  included.  To 
facilitate  inventory,  the  AFHRL  maintained  a  folder  for  each  data  collection 
team.  This  folder  contained  a  checklist  used  to  account  for  all  items  that 
should  have  been  inclixled  in  each  data  collection  package.  A  list  of  data 
collection  sites,  dates  of  visits,  and  the  name  and  telephone  nunber  of  the  POC 
at  each  site  were  also  kept  in  each  folder.  This  information  was  vital  in  the 
event  that  team  members  or  POCs  needed  to  be  contacted  during  the  data  collection 
effort. 

The  fonns  in  the  Data  Collection  Trip  Report  Package  (Appendix  A)  were  very 
useful  for  inventory  of  data  collection  packages  at  the  AFHRL.  The  sign-in 
sheets  were  \ised  to  verify  name  spelling  and  Social  Security  numbers.  The  data 
collection  schedule  was  xised  to  verify  the  nunber  of  incumbents  evaluated,  the 
number  of  co-workers  that  rated  each  incunbent ,  and  the  dates  that  each  phase  of 
the  data  collection  process  was  completed. 

The  AFHRL  reviewed  all  answer  sheets  for  completeness  and  correctness.  For 
each  incumbent,  the  following  were  required: 

1.  Self  rating  form  answer  sheet; 

2.  Supervisor  rating  form  answer  sheet; 

3.  Up  to  three  co-worker  rating  form  answer  sheet(s); 
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4.  ffTPT  answer  sheet(s); 

5.  JRr/AKT/SFT  answer  sheets; 

6.  Jms  Questionnaire;  and 

7.  General  Background  Questionnaire  Sv^plemental  answer  sheets  (one  for 
each  incunnbent,  supervisor,  and  co-worker). 

Bpecial  attention  was  paid  to  spelling  of  names  and  verification  of  Social 
Security  nunnbers.  Errors  that  could  not  be  corrected  due  to  lack  of  infomation 
and/or  missing  data,  were  reconciled  through  telephone  contact  with  the 
respective  team  proctors.  Answer  sheets  were  sorted  according  to  evaluation 
instninent  and  reviewed  for  irregular  markings.  Cnee  these  steps  were  completed, 
the  answer  sheets  were  suhtnitted  to  the  AFflRL  for  processing.  Controlled  test 
materials,  svtch  as  the  answer  sheets  for  the  A^  or  SFT  were  turned  over  to  the 
responsible  individual  at  the  AFHRL. 


IV.  lESSOMS  LEMNED  AMD  REXXMIEIIDATIGMS 

Collection  of  accurate  and  valid  data  is  an  essential  component  of  any 
empirical  research  effort.  Keys  to  the  success  of  data  collection  projects 
include  selection  and  training  of  personnel,  adherence  to  procedures, 
docunentation,  and  coordination  annng  concerned  parties.  A  systematic  approach 
to  the  management  of  the  JFMS  data  collection  was  developed  and  is  sumarized  in 
Figures  2  and  3.  Certain  lessons  were  learned  through  the  experience  of  three 
data  collection  efforts  and  the  approach  described  here  reflects  many 
modifications  based  on  previous  efforts.  The  lessons  learned  are  categorized 
into  issues  concerning  the  selection  of  proctors  and  TAs  and  procedural  matters. 
Futxire  efforts  of  a  similar  nature  may  benefit  from  the  lessons  learned  and 
recommendations  reported  here. 


Selection  of  Proctors  and  lAs 


Tedxucal  Experience 

Experience  with  the  technical  requirements  of  tasks  included  in  a  HTFT  is 
the  major  consideration  in  selection  of  TAs.  This  expertise  is  particularly 
important  for  tests  with  potential  safety  hazards  where  a  skilled  observer  is 
required  to  guard  against  improper  technique  of  an  inexperienced  incvxvbent.  It 
is  recommended  that  TAs  have  experience  in  all  duty  areas  covered  by  the  WTPT. 
For  example,  a  TA  in  AFS  732X0  ideally  should  have  experience  in  each  of  the  five 
workcenters  for  which  WTFTs  were  developed.  This  proficiency  allows  a  TA  to 
administer  all  WTPT  components  (i.e..  Phase  II  sections.) 

Technical  expertise  was  required  of  proctors  in  the  third  data  collection 
effort.  This  additional  capability  added  a  great  deal  of  flexibility  to  the 
project,  allowing  proctors  to  substitute  for  TAs  as  needed.  Proctors  with  AFS 
experience  also  enhanced  shadow  scoring  discussion  of  technical  issues. 
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EiperieDoe  with  JBi  Project 

Experience  with  the  JFM  project  is  another  criterion  to  be  considered  tdien 
selecting  proctors  and  Ths.  Active-duty  SMEs  who  attended  WTPT  develoEment 
workshops,  served  as  TAs  during  pilot  test  and  pretest,  or  acted  as  technical 
sources  during  task  analysis,  were  judged  by  researchers  on  their  potential  as 
test  adninistrators  or  proctors.  If  they  esqpressed  interest  in  continued 
involvement,  these  ixKlividuals  were  ti^n  named  in  messages  from  the  AEURL 
requesting  MAJCXH  support  for  data  collection.  Prior  experience  working  with 
SMEs  allowed  researchers  to  evaluate  technical  expertise,  as  well  as  professioanal 
conduct  and  interpersonal  skills  which  were  iirfortant  for  projecting  a  positive 
image  of  the  JFM  project. 


Selection  of  Active-Duty  Versus  Contractor  Personnel 

As  mentioned  previously,  active-duty  enlisted  members  and  civilian 
personnel  both  served  successfully  as  proctors  and  TAs.  The  following  are 
concerns  and  issues  that  were  discussed  and  evaluated  tdien  making  manning 
decisions  for  the  three  data  collection  efforts. 

1.  It  is  generally  believed  that  the  use  of  active-duty  TAs  and  proctors 
is  more  cost  effective  for  the  Air  Force.  This  is  contingent,  however,  on  the 
availability  of  the  tennporary  duty  (TDY)  funds  required  for  the  utilization  of 
enlisted  personnel.  Insufficient  TDY  funds  nandate  the  hiring  of  contractor 
perscnnel  to  insure  completion  of  data  collection  in  an  acceptable  time  frame. 

2.  The  availability  of  qualified  contractor  personnel  is  a  key  concern. 
The  most  likely  applicant  pool  consists  of  recently  retired  or  separated  enlisted 
personnel  from  the  AFS  under  evaluation.  However,  experience  proved  that  the 
short-term  nature  of  the  data  collection  period  made  it  difficult  to  hire  job 
experts  since  they  were  likely  to  prefer  more  lengthy  employment.  In  addition, 
some  career  field  members  were  extremely  marketable  in  the  private  sector  (e.g. , 
AFS  324X0,  AFS  328X0),  making  the  search  for  qualified  and  interested  applicants 
even  more  difficult. 

3.  Highly  skilled  personnel ,  who  also  understand  the  Air  Force  mission, 
are  more  easily  found  in  the  Air  Force  than  the  civilian  sector.  However,  there 
are  no  guarantees  about  the  sviitability  of  personnel  selected  by  the  MAJCXUs. 
In  the  second  and  third  data  collection  efforts,  the  MAJOCMs  were  asked  to  assign 
the  requested  personnel  for  a  period  of  several  weeks  but  were  often  reluctant 
to  do  so  since  it  was  difficult  to  maintain  mission  objectives  while  releasing 
personnel  for  TDY.  In  addition,  the  selection  criteria  are  very  specific  for  the 
proctor  position  (e.g.,  a  preferred  rank  of  Master  Sergeant  or  above, 
qualifications  in  all  work  areas  of  concern).  For  seme  career  fields  (e.g.,  AFS 
122X0),  staffing  patterns  included  only  a  small  nvxrber  of  these  individuals,  and 
mission  requirements  prevented  the  full  compliance  of  the  MAJOGMs  with  requests 
from  the  AEHRL.  In  these  instances,  the  MAJCXMs  filled  the  proctor  positions 
with  Technical  Sergeants. 

It  is  a  concern  that  bases,  when  tasked  to  release  an  £ME  for  the  TDY  data 
collection,  will  provide  the  most  expendable  person  in  the  unit.  While  the 
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overall  <juality  of  active-duty  persoomel  involved  in  the  JFMS  data  collection  was 
quite  high,  there  were  instances  where  the  personnel  did  not  meet  the  profile 
requested  by  the  AE11RL. 

4.  Hie  issue  of  test  security  and  confidentiality  must  also  be 
addressed.  It  is  clearly  stated  in  all  briefings  related  to  the  JFM  project  that 
the  data  collected  are  for  research  purposes  only  and  that  all  data  are 
confidential.  It  is  conmon  for  unit  and  base-level  personnel  to  inquire  as  to 
the  findings  and  overall  iirpressions  of  the  proctors  and  TAs.  Hie  only  allowable 
responses  to  inquiry  about  the  data  collection  results  are  positive  comnents  on 
the  support  received  from  local  personnel,  the  good  cooperation  and  effort  from 
the  examinees,  and  a  reiteration  of  the  research  mission.  Active-duty  personnel 
sometimes  felt  their  fellowAFS  members  might  benefit  from  such  iiqput,  regardless 
of  the  confidentiality  required. 

5.  Security  clearance  requirements  of  certain  specialties  (e.g.,  AFS 
324X0,  AFS  492X1)  are  another  concern.  Selection  of  active-duty  91Es  to  serve 
as  TAs  and  proctors  is  more  efficient  in  terms  of  time  and  money  since  new 
clearances  do  not  have  to  be  processed  through  the  Department  of  Defense. 

6.  Although  the  technical  skills  of  active-duty  personnel  are  probably 
more  current  than  those  of  available  private  sector  job  applicants,  certain  other 
necessary  skills  for  the  proctor  role  might  be  better  fulfilled  through  the 
selection  of  civilians.  For  example,  necessary  components  of  the  proctor 
position  are  briefing  base,  wing,  and  tjnit  management,  and  conducting  rater 
training  sessions.  Good  oral  corrmunl cation  skills,  a  conceptual  understanding 
of  the  purpose  of  the  JFM  Project  purpose,  and  an  ass\xred  presentation  style  are 
necessary  to  successfully  present  the  JFMS  and  respond  to  inquiries.  While  these 
comrunication  skills  are  part  of  the  professional  tredning  of  enlisted  personnel , 
many  career  fields  do  not  stress  this  aspect  and  the  NCXDs  may  not  acquire  the 
skills  as  necessary  for  participation  in  data  collection. 

In  the  second  data  collection  effort,  several  civilians  without  the 
specific  career  field  and/or  military  experience  successfully  fulfilled  the 
proctor  position.  Keys  to  their  success  included  understanding  of  research 
methods,  familiarity  with  the  JFMS,  vmderstanding  of  the  Air  Force  mission,  and 
good  interpersonal  and  comrunication  skills. 

Sunrary.  This  section  has  presented  many  pros  and  cons  on  issues  related 
to  selection  of  active  duty  versvis  civilian  personnel  for  JFMS  data  collection 
roles.  Both  groups  have  successfully  fulfilled  the  requirements  of  the  two 
positions  and  it  is  recommended  that  any  future  decisions  be  based  on 
consideration  of  the  specialty  being  studied  in  conjunction  with  the  above 
concerns . 


Scheduling 


Procedural  Matters 


1.  Hie  length  of  test  site  visits  can  be  problematic.  In  some  cases, 
testing  sites  with  large  nunnbers  of  first-term  incizrbents  were  scheduled  for 
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three-week  visits.  Team  members ,  however,  felt  that  after  two  weeks  at  one 
location  both  the  team  and  the  host  unit  suffered  a  loss  of  efficiency.  Many 
factors  were  involved  here,  including  excessive  familiarity  on  the  part  of  the 
hosts  with  the  test.  Also,  a  host's  tolerance  with  disruptive  scheduling  eroded 
and  a  team's  presence  began  to  be  regarded  as  a  nuisance.  TAs  also  seemed  to 
experience  "bum  out"  after  two  weeks  without  relief  from  the  daily  routine  of 
administering  the  WTPT.  Therefore,  data  collection  efforts  should  be  limited  to 
two  weeks  at  any  one  site,  regardless  of  the  incunnbent  population. 

2.  Schedules  should  be  planned  to  ensure  that  TAs  and  proctors  do  not 
visit  their  current  assignment  site  during  data  collection.  It  is  felt  that 
prior  familiarity  with  an  incurbent's  job  perfonrance  may  influence  perceptions 
of  WTPT  perfonrance.  It  was  found  in  early  data  collection  efforts  that  TAs 
returning  to  their  home  bases  for  data  collection  activities  were  likely  to 
become  distracted  by  work- related  issues,  which  in  turn  impacted  their  research 
duties. 

3.  Throughout  all  data  collection  efforts,  problens  occasionally  arose 
which  required  on-site  intervention  by  an  AETiRL  or  contractor  researcher.  To 
minimize  the  need  for  such  unscheduled  intervention,  a  researcher  should 
accompany  each  data  collection  team  on  their  first  site  visit.  These  visits 
allow  the  researcher  to  make  a  final  evaluation  of  the  team's  perfonrance  and 
serve  eis  information  sources  for  events  which  were  not  anticipated  during  the 
training  workshop.  In  addition,  periodic  on-site  visits  should  be  made  as  needed 
to  ensure  continued  adherence  to  procedure.  On-site  presence  of  researchers  also 
reinforces  the  need  for  the  teams  to  stay  in  close  contact  with  the  researchers 
and  helps  to  facilitate  good  working  relationships. 


Transportation  of  Materials 

Thorough  and  explicit  instructions  must  be  provided  to  the  test  proctors 
to  ensure  the  understanding  of  required  mailing  procedures.  Minor  problems  were 
experienced  related  to  the  mailing  of  data  collection  materials  and  tests.  For 
example,  inconplete  packages  were  received  at  the  AEMRL,  controlled  items  were 
mailed  without  proper  packaging,  and  data  from  multiple  bases  were  packaged 
together.  Most  of  these  problems  were  attributed  to  individuals  not  following 
mailing  requirements  and/or  procedures. 


Billeting 

Throughout  the  data  collection  efforts,  various  travel  discomforts  were 
encountered  by  active-duty  team  members.  Billeting  complaints  revolved  around 
three  major  factors:  privacy,  comfort,  and  cleanliness.  Minimum  standards  should 
be  established  for  billeting  to  include  unshared  quarters  with  sufficient  work 
space  and  room  for  storage  of  test  materials.  The  assurance  of  acceptable  living 
conditions  for  the  data  collection  teams  is  very  important.  Team  members  worked 
long  hours  for  extended  periods  away  from  home,  and  adequate  living  conditions 
are  the  most  visible  and  impressionable  factor  in  the  process. 
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Sumary  of  LessoDS  Learned  and  ReocnmeDdaticDS 


This  listing  of  lessons  learned  stimarize  a  great  deal  of  effort,  planning, 
and  experience  with  large-scale  data  collection  projects.  These  should  serve  to 
highlight  key  issues  and  supplement  the  data  collection  process  docunnented  by 
this  report.  Consideration  of  these  factors  can  greatly  facilitate  the  success 
of  any  data  collection  project. 


V.  COHCLDSICN 

This  docunent  has  recorded  in  an  historical  fashion  an  ideal,  yet 
realistic,  approach  for  collecting  job  performance  measurement  data.  The 
activities  described  in  detail  include  those  required  for  preparation,  procedures 
followed  at  each  data  collection  site,  and  the  docunnentation  and  organization 
efforts  required  for  successful  completion.  A  section  is  also  included 
concerning  the  lessons  learned  through  the  data  collection  and  reconmendations 
for  inproving  future  data  collection  efforts.  The  materials  contained  in  the 
appendices  enhance  the  report  by  providing  examples  of  the  measures  and  sipport 
materials  referenced  in  the  text. 

The  procedures  outlined  here  evolved  from  considerable  input  and 
experience,  and  represent  the  best  approach  for  collecting  the  most  accurate  and 
complete  data  on  the  JFHS.  Examination  of  these  issues  should  help  to  guide  any 
future  research  efforts  which  require  large-scale  implementation  of  a  data 
collection  plan.  Many  of  the  topics  addressed  are  not  exclusive  to  the  JFMS  ai^ 
are  applicable  across  a  wide  variety  of  research  areas  and  focal  populations. 
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MEMORANDUM  FOR  RECORD 

SUBJECT:  _  DATA  COLLECTION  TRIP  REPORT, 

(AFSC) 

1.  Data  Collection  General  Information: 

Dates  of  Visit:  _ 

Test  Quota:  _  Number  Tested:  _ 

In-Briefing  Date:  _ Out-Briefing  Date:  _ 

Person(s)  Attending  In/Out-Briefings: 

RANK/ NAME  OFF  SYM  POSITION 


2.  Specific  Information: 
a.  Rater  Training: 


(DATE) 

(BASE) 


30 


e.  Equipment  Set*Up: 


£.  Transportation: 


g.  Billeting: 


h.  Other  Comments  /  Recommendations: 


(PROCTOR'S  SIGNATURE) 


(PRINT  PROCTOR’S  NAME) 


7  Atchs 

1.  Data  Collection 
Trip  Summary 

2.  Test  Administrator's 
Comments/ 
Recommendations 

3.  Proctor's  Comments/ 
Recommendations 

4.  Data  Collection 
Schedule 

5.  Shadow  Scoring 
Documentation 

6.  Rater  Training 
Sign-in  Sheet 

7.  Job  Knowledge  Test 
Sign-In  Sheet 
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DATA  COLLECTION  TRIP  SUMMARY 


AIR  FORCE  SI>ECIALTYi 


PROCTOR: 

TEST  ADMINISTRATORS 

UES  /  AFHRL  REPRESENTATIVE 

WTPT  INFORMATION 

NUMBER  OF  AIRMEN  WTPT: 

NUMBER  OP  SHADOW  SCORES: 

JOB  KNOWLEDGE  TEST  INFO 

NUMBER  OP  AIRMEN  TESTED 

RATER  TRAINING 

NUMBER  OF  RATER  TRNG  SESSIONS:  _ 

NUMBER  OF  RATER  TRNG  FORMS: 

NUMBER  OF  TEST  SESSIONS: 

KEY  PERSONNEL  CONTACTED 


RANK/NANEs  _ 

ORGANIZATION: 

PHONE  NUMBER: 


FUNCTIONAL  AREA: 


OTHER  SUPPORT  PEOPLE 


FUNCTIONAL  AREA 


TEST  ADMINISTRATOn'S  COMMENTS  /  RECOMMENDATIONS 


PROCTOR'S  COHHENTS  /  RECOMMENDATIONS 


SHADOW  SCORING  DOCUMENTATION 


BASE: _ _  DATE; 


AFS/TEAM;  _  PROCTOR:  _ 

INCUMBENT:  _  ADMINISTRATOR; 


SHADOW  ADMINISTRATOR: 


NUMBER  TASKS  IN  DISAGREEMENT:  _  NUMBER  STEPS  IN  DISAGREEMENT; 

AMOUNT  OF  TIME  OF  SHADOW  CRITIQUE;  _ 


PLEASE  PROVIDE  DOCUMENTATION  ON  THE  SHADOW  SCORING  OF  THE  ABOVE  INCUMBENT. 
INCLUDE  ANY  PROBLEMS  WITH  SPECIFIC  TASKS  OR  STEPS.  PROCEDURAL  PROBLEMS, 
ETC..  ANY  TASKS  WHERE  MORE  THAN  TWO  STEPS  WERE  IN  DISAGREEMENT  OR  WHERE 
imERE  THE  TEST  ADMINISTRATORS  ARE  TWO  OR  MORE  POINTS  APART  REQUIRE  DIS¬ 
CUSSION  AND  DOCUMENTATIOtr, _ 
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MPHWDIX  C:  OODE  VMHES  FGR  AIBCKQI  LIFE  SDFFORT 
SPECIALIST  (APS  122XD) 


BASE  CODES: 


01  =  Altus  AFB,  GK 
02  =  Andrews  AFB,  MD 
03  =  Barksdale  AFB,  LA 
04  =  Beale  AFB,  LA 
05  =  Bergstrom  AFB,  TX 

06  =  Blytheville  AFB,  AR 
07  =  Bolling  AFB,  DC 
08  =  Cannon  AFB,  NM 
09  =  Carswell  AFB,  TX 

10  =  Castle  AFB,  CA 

11  =  Charleston  AFB,  SC 

12  =  Davis-Monthan  AFB,  AZ 

13  -  Dover  AFB, 

14  =  Dyess  AFB,  TX 

15  =  Ellsworth  AFB,  SD 

16  =  England  AEE,  LA 

17  =  Fairchild  AFB,  VIA 

18  =  Francis  E.  Warren  AFB,  WY 

19  =  George  AFB,  CA 

20  =  Grand  Forks  AFB,  MD 

21  =  Griff iss  AFB,  NY 

22  =  Grisson  AEB,  IN 

23  =  Holloman  AFB,  NM 

24  =  Homestead  AFB,  FL 

25  =  Hxirlburt  Field,  FL 

26  =  Kirtland  AFB,  Iti 

27  =  K.  I.  Sawyer  AFB,  MI 

28  =  Langley  AFB,  VA 

29  =  Little  Rock  AFB,  AR 


30  =  Loring  AFB,  ME 

31  =  Luke  AEB,  AZ 

32  =  MacDill  AFB,  Fl 

33  =  Malstrom  AEB,  MT 

34  =  March  AFB,  CA 

35  =  McChord  AEB,  HA 

36  =  McCoannell  AEB,  KS 

37  =  McGuire  AEB,  NJ 

38  =  Minot  AEB,  ND 

39  =  Moody  AEB,  GA 

40  =  Mountain  Home  AFB,  ID 

41  =  Myrtle  Beach  AEB,  SC 

42  =  Nellis  AEB,  NV 

43  =  Norton  AEB,  CA 

44  =  Offutt  AFB,  NE 

45  -  Pease  AEB,  NH 

46  =  Plattsburgh  AEB,  NY 

47  =  Pope  AEB,  NC 

48  =  Scott  AEB,  IL 

49  =  Seymour  Jdinson  AFB,  MC 

50  =  Shaw  AEB,  SC 

51  =  Travis  AEB,  CA 

52  =  Vaixlenberg  AEB,  CA 

53  =  Whiteman  AEB,  MO 

54  =  Wurtsmith  AEB,  MI 

55  =  _ 

56  =  _ 

57  =  _ 

58  =  _ 
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AFS  CX^:  AFS  122X0,  Aircrew  Life  Support  Specialist  =  12 

mASE  INFO:  AFS  122X0,  Strategic  Air  Connand  (SAC)  =  20 

AFS  122X0,  Military  Airlift  Ccnnaiid  (MAC)  =  30 
AFS  122X0,  Tactical  Airlift  Ccnnand  (TAC)  =  40 


EVALUATOR  OGOE: 


Proctor  - 

TSot  Fredridi  Rdsinscn 

(SAC)  =  20 

Proctor  - 

(SAC)  =  21 

Test  Administrator 

- 

SSot  Mario  Almestica 

(SAC)  =  22 

Test  Adnninistrator 

- 

Sot  Robin  Mitchell 

(SAC)  =  23 

Test  Administrator 

- 

(SAC)  =  24 

Proctor  - 

TSot  Ride  Nolocmott 

(SAC)  =  25 

Proctor  •• 

(SAC)  =  26 

Test  Adidnistrator 

SSert  Gary  Weir 

(SAC)  =  27 

Test  Administrator 

- 

Sot  Christina  Anderson 

(SAC)  =  28 

Test  Administrator 

- 

(SAC)  =  29 

Proctor  - 

MSot  Stanley  Johnson 

(MAC)  =  30 

Proctor  - 

(MAC)  =  31 

Test  Adidnistrator 

- 

SSot  Alan  Scruchfield 

(MAC)  =  32 

Test  Administrator 

- 

SSot  Ridiard  Wilson 

(MAC)  =  33 

Test  Administrator 

- 

(MAC)  =  34 

Proctor  - 

SSot  Steven  Skaoos 

(MAC)  =  35 

Proctor  * 

(MAC)  =  36 

Test  Administrator 

- 

SSot  Ronald  Price 

(MAC)  =  37 

Test  Administrator 

- 

SSot  Russell  Smith 

(MAC)  =  38 

Test  Administrator 

- 

(MAC)  =  39 

Proctor  - 

MSot  Jefferey  Crouch 

(rac)  =  40 

Proctor  - 

(TAC)  =  41 

Test  Administrator 

- 

TSot  Andrew  Graves 

(TAC)  =  42 

Test  Administrator 

- 

(TAC)  =  43 

Test  Administrator 

- 

(TAC)  =  44 

Proctor  - 

MSot  William  Lipsconf) 

(TAC)  =  45 

Proctor  - 

(TAC)  =  46 

Test  Administrator 

- 

SSot  Curtis  Heinrichs 

(TAC)  =  47 

Test  Administrator 

- 

(TAC)  =  48 

Test  Administrator 

- 

(TAC)  =  49 
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APPHOIX  D;  ERIEPING  AND  BKHESt  TNAIMIIK:  IBCT  AND  SLUES 
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RKieit  BOOHINQ  DimiJOCTClg  ERIfflNQ 


NOTE:  THE  RATE31  TRAINING  SESSION  HILL  TAKE  2-4  HOURS.  GIVE  THE  RATERS  AT 
UEAST  ONE  BREAK  DURING  THIS  TIME,  OR  HHENEVER  YOU  Fm.  IT  IS  APFRC»?RIATE. 

ALSO,  BEFORE  YOU  BEGIN  THE  BRIEFING,  ASK  THE  RATERS  TO  PLEASE  SIGN  THEIR  NAMES 
ON  THE  SIGN-IN  SHEET  TO  GIVE  YOU  A  RECORD  OP  HHO  HAS  ATTEIOED  A  RATER  TRAINING 
SESSION. 

SHOW  SLIDE  #1  -  JPMP 

Good  morning/afternoon.  I'm _ from _ and  I  em 

representing  the  Air  Force  Hvnan  Resources  Laboratory  at  Brooks  AEB.  You  nay 
already  know  that  we  are  here  as  part  of  the  Air  Force's  research  on  job 
perfomance  measurement.  I  would  like  to  take  a  few  minutes  to  give  you  some 
infomation  on  the  project  and  to  tell  you  what  we  will  be  doing  during  our 
visit,  and  how  you  will  be  involved.  After  nv  briefing,  we  will  spend  some 
time  going  through  a  rater  training  program.  Following  the  training  you  will 
be  asked  to  conplete  a  set  of  rating  forms  on  either  yourself,  your 
co-workers,  or  your  subordinates. 

[NOTE:  Introduce  the  test  adidnistrators ,  AFHRL  researchers,  and/or  UES 
representative  attending  the  briefing/ training.] 

SHOH  SLIDE  #2  -  (mSNlW 

First,  I  would  like  to  discuss  some  reasons  Uhy  we  are  conducting  this 
project.  The  work  we  have  done  over  the  past  year  in  this  career  field 
involves  the  development  of  several  ways  to  measure  an  individual's  ability  to 
perform  on  the  job.  I'll  then  discuss  our  plans  to  collect  job  performance 
information  vdiile  we're  here  and  the  payoffs  of  this  work  for  the  Air  Force. 

SHOH  SLIDE  #3  -  OBJECTIVES 

He  are  conducting  this  research  project  for  several  reasons.  First,  Congress 
has  asked  the  Services  to  reexamine  the  way  people  are  selected  and  assigned 
to  specialties,  and  how  they  are  performing  on  the  job.  The  Air  Force  is  also 
interested  in  using  job  performance  information  to  know  vAio  to  train  and  tdiat 
type  of  training  to  give. 

After  this  and  several  other  research  projects  are  completed,  the  information 
will  be  reviewed  and  analyzed.  The  primary  Adjectives  of  our  efforts  are  to 
gather  information  to  help  evaluate:  (1)  training  programs  and  (2)  selection 
wd  classification  procedures. 

SHOH  SLIDE  #4  -  JOB  PBIFORMANCE  MEASUREMENT  SYSTEM 

The  performance  measurement  system  that  has  been  developed  for  this  specialty 
consists  of  four  main  parts:  (1)  Halk-Through  Performance  Testing,  (2)  rating 
forms,  (3)  a  background/  experience  questionnaire,  and  (4)  job  knowledge 
tests. 
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Walk-through  performance  testing  consists  of  two  najor  sections:  (1)  hands-on 
performance,  and  (2)  an  interview.  Hands-on  requires  airT,ai  to  reform  tasks 
they  actually  do  on  the  job.  The  interview  requires  the  airmen  to  explain  the 
steps  involved  in  performing  tasks  they  actually  do  on  the  job. 

Four  different  types  of  rating  forms  were  developed.  These  rating  forms  will 
be  completed  by  the  airmen  \&)o  will  be  participating  i.i  the  Walk  Through 
Performance  Test,  their  supervisors,  and  some  of  their  co-workers.  These 
rating  forms  are:  (1)  Task,  (2)  Dimensional,  (3)  Global,  and  (4)  Air 
Force-Wide. 

We  will  also  collect  information  about  first-termers'  experience  with 
equipment  and  specific  tasks.  We  will  also  collect  some  information  on  your 
Air  Force  background. 

Each  person  participating  in  the  Walk  Through  Performance  Test,  will  also  be 
asked  to  take  job  knowledge  tests.  The  purpose  of  this  test  adntinist ration  is 
to  determine  if  performance  can  be  accurately  measured  with  a  multiple  choice 
test  format. 

SHOW  SLIDE  #5  -  DATA  GOLLECTIC^  SCHEDULE 

This  is  what  our  schedule  looks  like  for  your  base  and  other  bases  involved  in 
data  collection. 

[NOTE:  PROCTOR  SHOULD  TALK  THROUGH  THE  SCHEDULE,  STEP  BY  STEP.] 

SHOW  SLIDE  #6  -  AIR  FORCE  PASTOFFS 

What  will  this  work  accomplish?  It  will  improve:  (1)  the  measurement  of 
performance  on  the  job,  (2)  our  system  of  selecting,  classifying,  and  training 
individuals,  and  (3)  the  bottom  line  is  that  this  work  will  ultimately 
increase  mission  readiness. 
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BKrat  ismnnis  roxRSM 

PROCTOR'S  OOIEE 


SHOW  SLII»  #7  -  JFMS 


I.  IWTOODUCriOW 

An  inportant  ccnpcnent  of  the  Job  Perfotmnce  Measurement  System  is  a  series 
of  rating  forms.  Before  you  use  any  of  the  rating  forms,  we  are  going  to  talk 
about  each  form,  its  piurpose,  and  hew  to  use  each  form  to  effectively  rate  an 
individual.  We  are  also  going  to  discuss  seme  ideas  that  will  help  you  use 
the  rating  forms  to  make  the  most  accurate  ratings  possible. 

Following  this  training,  you  will  use  the  rating  forms  to  rate  the  performance 
of  yourself,  your  co-workers,  or  if  you  are  a  supervisor,  your  subordinates. 

It  is  essential  to  the  outcome  of  this  project  that  you  be  truthful  and  honest 
in  your  ratings.  The  ratings  will  not  be  seen  by  your  co-workers,  supervisor, 
or  anyone  else  connected  with  your  unit.  The  data  collected  will  be  seen  only 
by  Air  Force  Huran  Resoturces  Laboratory  personnel  and  the  private  contractor 
associated  with  this  project.  The  information  you  provide  will  be  coded  to 
assture  confidentiality  and  the  rating  forms  will  subsequently  be  destroyed. 

The  ratings  will  be  used  for  research  purposes  only  and  will  in  no  way  affect 
anyone's  career.  Therefore,  please  rate  each  person  as  accmrately  as 
possible. 


SHOW  OVERHEAD  OF  LIST  OF  RATING  FORMS  (SLIDE  «8) 


You  will  complete  four  types  of  rating  forms  on  each  individual.  The  Global 
Rating  Form  is  the  most  general,  requiring  ratings  of  a  person’s  overall 
technical  and  interpersonal  proficiency.  The  Dimensional  Rating  Form  asks  for 
ratings  on  major  job  areas,  while  the  Task  Rating  Form  requires  you  to  rate  a 
person  on  specific  job  tasks.  The  Air  Force-Wide  Rating  Form  is  somewhat 
different  because  it  contains  important  factors  that  are  conmon  to  all  Air 
Force  career  fields,  not  just  your  specialty. 

These  rating  forms  will  be  discussed  later  in  this  training. 


TURN  OFF  OVERHEAD  PROJECTOR 
DISTRIBUTE  COPIES  OP  RATING  FORM  BOOKLETS. 
IDEXn'IFY  NTPT  INOJMBEirTS  AS  YOU  HAND  OUT  BOOKS. 
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II.  RATING  ERRORS  EXERCISE 

The  first  page  of  your  rating  form  book  contains  a  Privacy  Act  Statement. 
Please  read  this  statement  as  time  allows.  On  page  2  of  your  rating  form  book 
you  will  find  a  conversation  between  several  shift  supervisors.  Some  of  their 
conments  suggest  certain  biases  they  have  vhesi  making  ratings.  Try  to 
identify  the  biases  as  we  read  the  conversation. 


ASK  VOLUNTEEI^  OR  SELECT  FOUR  PEOPLE  IN  THE  GROUP  TO  ASSUME 
THE  ROLES  OF  ANDREWS,  CULLElt,  BAKEK,  AND  DAVIS.  HAVE  THEM  READ 
THE  FOLLOWING  CONVERSATION 


Andrews:  Here  we  are  again  at  our  weekly  gripe  session. 

Baker:  Yeah.  Seems  like  we  never  run  out  of  problems  to  complain  about. 

Cullen:  I  don't  know  why  you  people  have  so  many  problems  on  your  shift. 

Baker:  Because  we  don't  have  the  "cream  of  the  crop"  that  you  have. 

Cullen:  You've  got  the  same  kind  of  people  working  for  you  that  I  have. 

Just  think  about  it.  All  the  airmen  take  tests  to  identify  vho 
has  the  aptitude  for  what.  Right? 

Andrews :  Right . 

Cullen:  <K.  So  you've  got  a  bunch  of  people  with  an  aptitude  for  Life 

Support.  These  recruits  all  receive  the  same  training  at  tech 
school  to  learn  to  be  competent.  They  all  come  out  of  Chanute 
with  the  same  training.  So  there  shouldn't  be  anyone  on  your 
shift  who  is  more  qualified  to  do  the  job  than  someone  else. 

Sure,  if  you  take  any  one  of  the  3-levels  and  compare  that  person 
to  the  average  person  on  the  street,  he's  going  to  look  like  a 
genius.  But  among  his  fellow  workers,  he's  just  another  average 
guy  like  all  the  rest. 

Andrews:  I  disagree.  On  my  shift,  I've  got  a  couple  of  people  who  are  just 

outstanding.  Next  to  these  airmen,  the  rest  of  my  people  are  way 
below  average. 

Baker:  I  know  what  you  mean.  I  received  a  new  airman  two  weeks  ago.  You 

wouldn't  believe  how  badly  that  person  has  performed  in  the  short 
time  on  the  job.  I  guess  I've  got  a  real  loser  on  my  hands. 

Davis:  Let  me  tell  you  about  the  last  recruit  that  came  onto  my  shift. 

She  was  fresh  out  of  Chanute.  She  hadn't  been  here  but  a  co\;q>le 
of  weeks  and  I  gave  her  a  CBO  mask  to  inspect .  Kel 1 ,  she  did  the 
complete  inspection  like  a  pro.  Ihe  QC  guy  couldn't  find  a  thing 
wrong  with  it.  I  think  I  have  a  super  recrvdt  in  this  person.  I 
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mean,  if  she  can  do  that,  she  can  do  just  about  anything  I  assign 
her  to  do. 


Andrews:  You  know,  Cullen,  I've  heard  hoM  difficult  you  can  be  when  you 

rate  your  airmen.  I've  heard  seme  of  your  people  conplain  that  no 
natter  how  hard  they  try,  you  won't  give  thm  more  than  an  average 
rating.  They  say  they  feel  like  they're  beating  their  heads 
against  a  brick  wall. 

Cullen:  I  have  a  pretty  good  idea  tdio  you're  talking  about.  If  they  think 

it's  hard  to  get  a  good  rating  out  of  me  now,  jtist  wait  until  I 
rate  them  the  next  time.  They'll  find  out  h^  hard  a  brick  wall 
really  is. 


Andrews:  I  guess  I  don't  think  like  you  people  at  all.  I  try  to  be  a 

friend  to  my  people.  Some  of  them  are  away  from  home  for  the 
first  time  and  I  don't  like  to  make  it  any  rougher  on  them  than  I 
need  to.  I  try  to  give  my  pec^le  the  benefit  of  the  doubt  tdien 
I'm  rating  them.  You'd  be  surprised  what  you  learn  about  your 
people  if  you  try  to  be  their  friend.  For  instance,  there's  a  guy 
on  my  shift  now  who  reminds  me  of  myself  when  I  was  his  age.  He's 
from  a  small  town  and  joined  the  service  to  see  a  little  of  the 
world.  I  can  really  identify  with  him. 

Davis:  Well,  I  don't  know  about  being  buddy-buddy  with  my  people,  but  I 

do  know  that  right  now  everyone  in  my  unit  is  doing  a  good  job  as 
far  as  I'm  concerned. 


Andrews:  Why  is  that? 

Davis:  Well,  I'm  vp  for  promotion  in  a  couple  of  months.  And  let's  face 

it,  the  better  my  people  look  on  their  ratings,  the  better  I  look 
as  a  supervisor.  And  the  better  I  look,  the  better  my  chances  are 
for  promotion! 


BE)GIN  IHE  DISCUSSION.  SAY: 

This  conversation  includes  many  of  the  conmon  mistakes  made  in  performance 
ratings.  We  want  to  point  these  out  to  you  and  then  discuss  ways  to  make  more 
accurate  ratings. 

The  third  time  Cullen  speaks,  he  talks  about  how  every  member  of  a  section  has 
the  same  training  and  qualifications.  His  way  of  thinking  directs  him  to  the 
incorrect  conclusion  that  everyone  is  average.  He  is  likely  to  give  only 
average  performance  ratings  to  his  subordinates,  and  will  probably  not 
recognize  outstanding  or  even  below  average  performance. 

Andrews  makes  a  mistake  in  the  next  statement  by  comparing  airmen  with  each 
other.  The  lesson  here  is  to  rate  each  person  according  to  his  or  her  own 
ability  to  do  the  job. 
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Baker  follows  by  naking  a  jvKl^nent  that  an  airman  is  a  real  loser,  when  he's 
only  been  in  the  section  a  couple  of  weeks.  When  you  make  your  ratings,  be 
sure  to  base  them  on  a  number  of  observations  of  a  person's  performance  and 
not  just  on  one  incident. 

Davis  makes  the  next  mistake  when  he  assumes  that  if  an  airman  can  do  one  task 
wel  1 ,  she  can  do  everything  wel  1 .  When  you  make  your  ratings ,  try  not  to  make 
this  type  of  misleading  assurption.  In  other  words,  just  because  a  person 
gets  a  high  rating  on  one  task  or  dimension,  that  doesn't  mean  the  person  will 
also  get  high  ratings  on  the  other  tasks  or  dimensions.  Each  task  must  be 
considered  separately.  The  same  applies  for  low  ratings. 

Andrews  states  that  Cullen  has  a  reputation  of  being  an  unreasonably  tough 
rater  and  in  the  next  statement  Cullen  confirms  this  fact.  Cullen  is  not 
basing  his  ratings  on  observed  behavior.  Instead,  he  is  using  the  low  ratings 
as  a  way  to  get  revenge  on  his  section.  Some  people  might  use  high  ratings  to 
reward  others.  Either  way  is  unfair.  Once  again,  the  rule  here  is  to  base 
your  ratings  on  observed  behavior  -  behavior  that  you  can  see. 

In  the  next  statement,  Andrews  indicates  that  he  is  an  easy  rater.  On  top  of 
that,  Andrews  is  likely  to  rate  a  person  higher  if  that  person  is  somehow 
similar  to  himself  in  background,  interests,  and  so  on.  Agsdn,  base  your 
ratings  on  observed  behavior. 

Finally,  in  the  last  statement,  Davis  is  assuming  that  his  own  worth  as  a 
supervisor  is  enhanced  by  the  favorable  ratings  he  gives  his  section  members. 
He  would  not  be  likely  to  give  low  ratings  because  that  would  make  him  look 
bad  as  a  supervisor.  The  ratings  you  give  will  in  no  way  reflect  back  on  you 
or  those  you  rate. 

In  siximary,  the  one  most  important  thing  to  remember  when  making  your  ratings 
is  to  focus  on  behavior  you  have  observed  and  base  the  ratings  on  this 
behavior. 


III.  EXPLATiATIOW  OF  RATING  SCALE 


TORN  ON  OVERHEAD  PROJECTCR 
SHOW  OVERHEAD  OF  PROFICIEMCY  RATING  SCALE  (SLIDE  #9) 


Each  rating  form  you  will  be  completing  uses  a  5-point  scale  ranging  from  5 
high  -  1  low.  To  help  you  make  more  accurate  ratings,  the  points  on  the  scale 
are  labeled.  You  will  notice  that  these  labels  describe  a  certain  level  of 
proficiency.  Proficiency  refers  to  how  skilled  a  person  is  at  performing 
various  tasks  on  the  job,  ignoring  interpersonal  factors (such  as,  willingness 
to  work  and  cooperating  with  others)  or  situational  factors  (such  as,  lack  of 
tools  or  parts  and  equipment  outages).  In  other  words,  proficiency  is  vdiat 
the  person  can  do,  without  taking  outside  factors  into  account. 
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iraMTIEY  KEY  WORDS  OR  FHRASEIS  ON  SLIDE 
TURN  OFF  CfVERHEAD  PROJBCTCXl 
ASK: 

ARE  IHERE  ANY  QUESTIONS  REGARDING  THE  RATING  SCALE? 


IV.  EKPIANATION  OF  RATING  FORMS 


These  are  the  rating  form  booklets  you  vd.ll  be  using  later.  They  contain  four 
different  types  of  forms,  vfith  tvro  or  more  itens  vd.thin  each  category.  We 
vdll  briefly  look  at  each  form.  Please  do  not  mark  in  these  booklets.  Nom 
turn  to  the  Global  Rating  Form  on  page  12.1he  first  page  of  each  rating  form 
contains  an  explanation  of  the  form,  as  viell  as  instnictions  for  its 
completion.  Always  read  the  instruction  page  before  proceeding. 


A.  GLOBAL  RATING  FORM 

This  rating  form  has  only  two  itens.  The  first  item  asks  for  a  rating  of  a 
person's  overall  technical  proficiency.  Technical  proficiency  refers  to  how 
skilled  someone  is  at  performing  various  tasks  on  the  job.  Focus  on  what  the 
person  can  do  and  ignore  interpersonal  or  situational  factors.  The  second 
item  asks  for  a  rating  of  a  person's  overall  social /interpersonal  proficiency. 
Interpersonal  proficiency  refers  to  how  well  someone  viorks  vd.th  various  levels 
of  supervision  and  how  cooperative  an  individual  is  on  a  task  requiring  team 
effort.  This  form  utilizes  behavioral  exanples  to  aid  you  in  making  your 
ratings.  Take  time  to  examine  the  two  global  rating  forms  on  pages  13  and  14 
of  the  rating  form  book. 


ALLOW  TIME  FOR  EXAMINATION  OF  FORMS.  THEN  SAY: 
Please  turn  to  the  Dimensional  Rating  Form  on  page  15. 


DIRECT  ATTEimON  TO  INSTRUCTION  PAGE  AND  NOTE  IHAT 
THE  INSTRUCTIONS  PRECEDE  THE  FORMS. 


B.  DIMENSIONAL  RATING  FORM 

The  purpose  of  this  rating  form  is  to  evaluate  a  person's  level  of  proficiency 
on  a  number  of  important  j<^  areas  or  dimensions.  Remember,  proficiency 
refers  to  what  a  person  can  do.  ignoring  interpersonal  or  situational  factors. 
Again,  the  exanples  vd.ll  serve  as  a  guide  in  determining  your  ratings. 

Note  that  the  dimensions  on  vdiich  you  vd.ll  rate  the  individual's  performance 
include  Acbninist ration.  Helmets  and  Oxygen  Masks,  Survival  Equiiment,  Aircrew 
Clothing,  Chendcal  Defense  Equipment,  and  Training  and  Instruction. 
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Take  time  now  to  review  the  dimensional  rating  tome  on  pages  16  through  21  in 
the  rating  fonn  book. 

ALLOW  TIME  FOR  EXAMINATION  OF  FORM.  THEN  SAX: 

Please  turn  to  the  Task  Rating  Fonn  on  page  22. 

CALL  ATTSHTION  TO  INffTROCrTION  PAGE 


C.  TASK  RATING  FORM 

The  purpose  of  this  rating  fonn  is  to  evaluate  performance  on  a  variety  of 
tasks  critical  to  first-term  Air  Force  Aircrew  Life  Support  Specialists.  This 
fom  contains  tasks  perfonned  by  all  Aircrew  Life  Siqpport  Specialists,  as  well 
as  tasks  unique  to  each  Conmand.  Remember,  we  are  concerned  with  the  level  of 
ability  to  perfom  these  tasks,  not  interpersonal  or  situational  factors. 
Please  look  at  the  task  ratings  on  page  23-24.  It  is  important  that  you  make 
yoior  most  accurate  rating  on  each  task  in  the  list. 


ALLOW  TIME  FCX%  EXAMINATION  OF  FCSQ4.  IHEN  SAY: 
Please  turn  to  the  Air  Force-Wide  Rating  Fom  on  page  25. 


CALL  ATTENTION  TO  INSTRUCmON  PAGE. 


D.  AIR  FORCE-WIDE  RATING  FORM 

This  rating  fom  does  not  evaluate  technical  job  skill.  It  rates  a  person  on 
elanents  important  to  overall  success  in  the  Air  Force.  This  rating  fom  uses 
performance  rather  than  proficiency  as  a  basis  for  rating  scale  anchors.  We 
will  discuss  this  rating  fom  in  more  detail  later.  Please  review  the  forms  on 
pages  26  through  33. 


ALLOW  TIME  FOR  EXAMINATION  OF  FORM.  THEH  SAY: 
Please  turn  to  the  General  Background  Questionnaire  on  page  34. 


E.  OIHER  QUESTIONNAIRES 

You  will  notice  that  there  are  several  other  questionnaires  in  eaoh  rating 
fom  booklet.  The  General  Background  Questionnaire  on  page  34  through  page  35 
asks  for  information  on  you.  Please  take  a  moment  to  review  this  fom. 


ALLOW  TIME  FOR  EXAMINATION  OF  FORM.  THEN  SAY: 
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Oil  the  first  page  of  this  questionnaire  there  is  one  area  that  we  are  asking 
you  to  fill  in.  We  will  provide  you  with  a  separate  copy  of  this  form  for  you 
to  conplete. 

The  next  form  is  the  Rating  Form  Questionnaire  cn  page  36.  This  form  asks  for 
your  feedback  on  the  rating  forms.  Please  take  a  moment  to  review  this  form. 

You  will  notice  that  there  is  a  note  of  caution  on  page  38.  The  items  on  page 
39  are  not  rated  using  the  same  scale  as  the  previous  items  on  the  Rating  Form 
Questionnaire.  On  page  39,  you  are  asked  to  give  your  opinions  about  the 
rating  forms  by  rank-ordering  them  on  a  1  to  4  scale,  with  1  being  the  best 
and  4  being  the  worst.  Use  each  ranking  nunber  only  once  for  each  question. 
Please  read  the  instructions  on  page  35  carefully  before  answering  items 
39-50. 


ALLOW  TIME  FOR  EXAMINATION  OF  FORM.  THEN  SAY: 

The  Task  Experience  Questionnaire  on  pages  41-12  is  to  be  completed  only  by 
those  of  you  who  have  been  selected  to  participate  in  the  Walk-Through 
Performance  Test  and  are  providing  self-ratings.  Please  take  a  moment  to 
review  this  form. 


TURN  ON  OVERHEAD  PROJECTOR 

SHOW  OVERHEAD  -  COMPLETING  THE  RATING  FORMS  (SLIDE  *10) 


If  you  have  been  selected  to  provide  ratings  on  several  co-workers  or 
subordinates,  you  will  only  complete  these  supplemental  questionnaires  once. 
You  should  use  the  first  answer  sheet  you  fill  in  to  complete  these 
questionnaires.  If  you  are  rating  yourself,  \jse  your  "self"  answer  sheet  to 
complete  the  questionnaires.  Are  there  any  questions  regarding  the  rating 
forms? 


V.  EXPLANATION  OF  BEHAVIORAL  EXAMPLES 


SHOW  OVERHEAD  OF  DIMENSION  1  -  AEMINISTRATION  (SLIDE  #11) 

REFER  TO  THE  OVERHEAD  AND  SAY: 

This  particular  item  rates  a  person's  level  of  proficiency  in  the  area  of 
Admnistration.  Notice  that  a  definition  is  given  first. 

POINT  TO  AND  READ  DEFINITION 

The  definition  is  followed  by  five  levels.  For  each  level,  there  is  a 
corresponding  rating  ninber.  This  mxiiber  identifies  the  rating  that 
corresponds  to  the  level.  This  is  the  nvmerical  rating  you  will  use  to  record 
onto  yovur  answer  sheet.  A  set  of  behavioral  examples  is  provided  for  each  of 
the  five  levels.  These  examples  refer  to  various  levels  of  performance. 


54 


POINT  TO  EXAMPLES.  IDENTIFY  KEY  WORDS  OR  PHRASES  1HAT  SUPPORT  IHE 
RATING.  READ  THROUGH  EACH  BCAMPLE,  BEGINNING  WITH  LEVEL  5. 

IHEN  SAY: 

It  is  ini>ortant  that  you  read  all  the  exanples  thoroug^y  before  deciding  cxi  a 
rating.  Do  not  expect  a  person's  bc^vior  to  be  identical  to  a  given  exanple. 
The  exanples  are  in  no  way  meant  to  include  all  possible  behaviors.  Use  the 
examples  only  as  guidelines  for  detennining  a  rating. 


ASK: 

Are  there  any  questions  regarding  the  rating  scale? 
DISTRIBUTE  SAMPLE  ANSWER  SHEETS  AMD  NO.  2  PENCILS 


VI.  PRACTICE  EXERCISE  FOR  RATING  FC»MS 

Now  you  will  have  the  opportunity  to  practice  using  two  of  the  rating  forms 
that  have  been  discussed,  the  Dimensional  and  Air-Force  Wide  Rating  Forms. 
The  purpose  of  this  exercise  is  to  help  you  become  familiar  and  comfortable 
with  these  rating  forms  and  to  address  any  questioois  or  concerns  you  might 
have  regarding  its  use. 


SHOW  OVERHEAD  OF  ANSWER  SHEET  (SLIK!  #12) 


I  have  given  each  of  you  a  sample  version  of  the  answer  sheets  you  will  be 
using  later.  For  now,  you  will  only  be  concerned  with  the  Dimensiognal  section 
of  the  answer  sheet.  Each  of  the  rating  forms  are  equally  important  but  we 
are  highlighting  the  Dimensional  form  now  as  an  example. 


POINT  TO  DIMENSIONAL  SECTION  ON  SLIIS. 


Now  turn  to  page  6,  Exercise  I,  in  your  training  booklet. 


A.  EXERCISE  I  -  DIMENSIONAL  RATING  FORM 

We  are  going  to  read  a  story  and  use  the  information  in  it  to  conplute  a 
sample  Dimensional  Rating  Form  on  SRA  Shdth.  For  now,  you  will  only  be 
concerned  with  Dimensions  1,  2,  4,  and  6  of  the  Dimensional  rating  form.  Turn 
to  page  7  and  let's  read  the  story. 

READ  THE  STORY  OUT  LOUD  FOR  EVERYONE.  AFTER  YOU  FINISH,  PAUSE  FOR  A 
MOMENT  TO  ALLOW  THE  PEOPLE  TO  THINK  ABOUT  THE  STORY. 
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Upon  arriving  at  the  shop  one  morning  SRA  Sknith  was  asked  to  make  a 
conprehensive  list  of  parts  the  shop  needed  to  ccnplete  a  major  modification 
of  a  piece  of  equipment.  She  required  minimal  assistance  and  did  a  thorough 
and  accurate  job  of  researching  part  nxxnbers.  All  the  required  forms  were 
conpleted  with  only  minor  errors  (Dl-4). 

Later  that  same  day  smith  was  selected  to  perform  a  periodic  inspection  of  an 
oxygen  nask.  She  was  called  upon  because  she  had  consistently  conpleted  these 
periodic  inspections  rapidly  and  accurately  without  supervision  (D2-5). 

During  the  cornn  check  she  discovered  that  the  microphone  was  inoperable  and 
nade  the  required  repairs. 

After  smith  finished  inspecting  the  oxygen  mask,  an  aircrew  member  came  in  to 
have  a  parachute  fitted.  SRA  Smith  performed  the  fitting  procedure  very 
clumsily  and  left  several  twists  in  the  mains lino.  In  addition,  she  forgot  to 
show  the  excess  webbing.  Her  supervisor  had  to  correct  her  and  told  her  to  be 
more  careful  in  the  future  (D4-2). 

Before  leaving  for  the  day  SRA  Smith  was  told  that  the  chem  defense  training 
she  had  scheduled  for  the  following  day  had  been  canceled.  She  decided  that 
rescheduling  could  wait  until  the  next  wedc.  smith  was  actually  pleased  that 
the  training  was  postponed  because  she  was  not  as  well  prepared  as  she  should 
have  been  and  had  been  in  the  past  (D6-3). 

rNOTE  TO  PROCTORS:  TOE  UNDERLINED  STATEMENTS  ARE  JUSTIFICATIONS  FOR  RATINGS. 
TOE  PARENTHETICAL  NOTATION  FOLLOWING  EACH  STATEMENT  REFERS  TO  TOE  SPECIFIC 
DIMENSION/PERPORMftNCE  FACTOR  NUMBER  AND  ITS  APPROPRIATE  RATING.] 

Now  turn  to  the  Dimensional  Rating  Form  on  page  15  and  conplete  the  first 
dimension  *  Adranistration.  When  you  are  all  finished  we  will  discuss  the 
first  rating  as  a  group.  Please  read  each  "Behavioral  Example"  before 
deciding  upon  a  rating. 

PAUSE  AND  ALLOW  EVERYONE  TOE  OPPC^TONITY  TO  RESPOND  TO  TOE  FIRST 
DIMENSIONAL  RATING.  WHEN  IT  APPEARS  TOAT  TOE  MAJCXIITY  OF  TOE  PEOPLE 
HAVE  OCMPLETED,  CONTINUE: 

What  rating  did  you  give  Smith  on  Dimension  number  1:  Adninistration?" 

SHOW  SLII£  «13 

The  appropriate  rating  would  be  a  4.  The  paragraph  states:  She  completed  all 
the  required  forms  with  only  minor  errors.  Any  questions? 

TURN  OVERHEAD  PROJECTOR 

Now  I  want  you  to  rate  Smith  on  Dimensional  Rating  Forms  2,  4,  and  6  on  pages 
17  through  21.  When  you  are  finished,  we  will  discuss  the  ratings. 
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PAUSE  AND  ALLOW  EVEKJTCME  TO  CXMPLETE  THE  RATINGS  FCR  DIMENSIONS  2,  4, 
and  6.  YOU  MAY  WANT  TO  WALK  AROUND  THE  ROOM  AND  FROVIIS  ASSISTANCE  AS 
NEEDED.  WHEN  EVERYONE  IS  ABOUT  FINISHED  CONTINUE  TO  DISCUSS  THE 
RATINGS. 

'Vhat  rating  did  you  give  Skidth  on  Dimension  nurber  2:  Helmets  and  Oxygen 
Masks" 

SHOW  SLIDE  #14 

"The  appropriate  rating  would  be  a  5.  The  paragraph  states:  She  had 
consistently  conpleted  these  periodic  inspections  rapidly  and  accurately 
without  supervision.  Any  questions? 

"What  rating  did  you  give  Smith  on  Dimension  nvirber  4:  Aircrew  Clothing" 

SHOW  SLIDE  #15 

The  appropriate  rating  would  be  a  2.  The  paragraph  states:  SRA  Smith 
performed  the  procedure  clumsily,  left  several  twists  in  the  mainsling,  and 
forgot  to  show  the  excess  webbing.  Her  stipervisor  had  to  correct  her  and  told 
her  to  be  more  careful .  Any  questions? 

"What  rating  did  you  give  Smith  on  Dimension  nunber  6:  Training  and 
Instruction" 


SHOW  SLIDE  #16 

The  appropriate  rating  would  be  a  3.  The  paragraph  states:  Smith  was  actually 
pleased  that  the  training  was  postponed  because  she  was  not  as  well  prepared 
as  she  should  have  been  and  had  been  in  the  past. 


B.  EXERCISE  II  -  AIR  FORCE-WIDE  RATING  FORM 

SHOW  OVENHEAD  OF  PERFCX»(ANCE  BASE  RATING  SCALE  (SLIDE  #17) 


Now  we  will  discuss  the  Air  Force-Wide  Rating  Form.  Since  the  Air  Force-Wide 
Form  is  not  technical  in  its  orientation,  the  scale  on  this  form  refers  to 
various  levels  of  performance  rather  than  levels  of  proficiency.  The  rating 
form  will  examine  not  only  technical  ability,  but  also  other  factors  that 
contribute  to  a  personnel  specialist's  performance  on  the  job.  Performance 
refers  to  how  a  person  actually  does  on  the  job,  as  opposed  to  what  he  can  do. 
Each  rating  form  uses  a  5-point  scale  ranging  from  5  high  -  1  low.  To  help 
you  make  more  accurate  ratings,  the  points  on  the  scale  are  labeled.  You  will 
notice  that  these  labels  describe  a  certain  level  of  performance. 

SHOW  OVERHEAD  OF  PERFORMANCE  FACTOR  5:  LEADERSHIP  (SLIDE  #18) 

This  particular  item  rates  a  person's  level  of  performance  in  the  area  of 
Leadership.  Notice  that  a  definition  is  given  first. 
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POINT  TO  definit:ck 


Itie  defiziitian  is  folloirad  by  five  levels.  For  each  level,  there  is  a 
corresponding  rating  nunnber.  This  number  identifies  the  rating  that 
corresponds  to  the  level.  This  is  the  n\inerical  rating  you  will  use  to  record 
onto  your  answer  sheet.  A  set  of  behavioral  exanples  is  provided  for  each  of 
the  5  levels.  These  exaitples  refer  to  various  levels  of  performance. 


POINT  TO  EXAMPLES.  USDTIPY  KEi  WXLS  GR  PHRASES  THAT  SUPPORT  THE 
RATING.  READ  THROUCSI  EACH  EXAMPLE,  BEGINNING  WITH  LEVEL  5. 

THQl  SAY: 

It  is  inportant  that  you  read  all  the  exanples  thoroughly  before  deciding  on  a 
rating.  Do  not  expect  a  person's  behavior  to  be  identical  to  a  given  exanple. 
The  exanples  are  in  no  way  meant  to  include  all  possible  behaviors.  Use  the 
exanples  only  as  guidelines  for  determining  a  rating. 


ASK: 

Are  there  any  questions  regarding  the  rating  scale? 

TURN  OVERHEAD  PROJECTOR  OFF 

Now  you  will  have  the  opportunity  to  practice  using  the  Air  Force  Wide  rating 
form  that  has  been  discussed.  The  purpose  of  this  exercise  is  to  help  you 
become  familiar  and  comfortable  with  this  rating  form  and  to  address  any 
questions  or  concerns  you  might  have  regarding  its  tee.  During  this  exercise 
you  will  again  use  the  sanple  answer  sheet,  but  this  time  you  will  focnos  on 
the  Air-Force  Wide  secticm. 

HOLD  UP  AN  ANSWER  SHEET  AND  POINT  OUT  THIS  SECTION 

Now  turn  to  page  8,  Exercise  II,  in  your  training  booklet. Read  the  story  and 
use  the  information  in  it  to  rate  Jones  on  Air  Force  Wide  Performance  factors 
1,  2,  3,  and  7  on  pages  26  -  32  of  your  book.  When  you  are  all  finished  we 
will  discuss  the  ratings  as  a  group.  Please  read  each  "Behavioral  Exanple" 
before  deciding  upon  a  rating. 

PROVIDE  ENOUGH  TIME  FOR  EVERYONE  TO  READ  THE  FOLLOWING  STC»Y 

SRA  Jones  has  his  5-skill  level  rating  and  has  been  performing  the 
duties  of  a  trainer  since  shortly  after  attaining  this  rating.  His 
supervisors  have  often  remarked  on  his  exceptional  abilities  to  the  extent 
that  they  are  comfortable  in  allowing  him  to  work  virtually  unsupervised 
(PFl-4).  He  is  one  of  their  strongest  team  members,  generally  showing  sound 
iudcroent  under  pressure  and  quickly  becoming  a  role  model  for  some  of  the  less 
experienced  members  of  the  shop  (PF5-5).  On  one  occasion,  a  major  unplanned 
exercise  was  announced.  Although  Jones  was  scheduled  to  go  on  leave  during 
this  time,  he  volimteered  to  remain  to  offer  any  support  and/or  fill  in  if 
necessary  (PP2-5).  Another  time  he  discovered  that  a  torque  wrench  had 
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disappeared  fron  the  shop.  Being  a  truthful  person,  Jones  informed  his 
supervisor  and  volunteered  to  investigate  the  disappearance  and  to  stay  until 
the  vnrench  was  found  (PF4-4). 

This  type  of  performance  has  lead  his  sx^ervisors  to  encourage  him  to 
put  more  effort  into  studying  his  CDC  naterials  so  that  he  can  attain  his 
7-skill  level.  Though  it's  apparent  that  he  could  conplete  the  course 
rapidly,  he  has  chosen  not  to  push  himself  and  sirnply  wants  to  complete  the 
course  recruirements  in  the  prescribed  time  (PE7-3). 

SRA  Jones  has  been  placed  on  a  6-month  weight  control  program  in  which 
he  must  Ic^e  20  pounds  (PF6-2).  He  claims  that  he  eats  to  release  the  tension 
from  the  job,  and  will  occasionally  go  out  with  others  for  a  few  beers  after 
work  on  a  particularly  touch  dav  (PF3-8).  He  hates  the  weight  control  program 
and  only  participates  because  he  is  under  orders  to  do  so.  Due  to  this 
attitude,  he  has  failed  to  present  himself  for  periodic  weigh-ins  (PF3-2). 


HHEX«  IT  APPEARS  'KAT  THE  MAJORITY  IHE  PEOPLE  HAVE  CXliPLETED, 
CONTINUE 

There  are  key  statements  in  this  story  that  indicate  the  ratiixg  that  Jones 
should  receive  on  each  performance  factor  of  the  Air  Force-Wide  Rating  Form. 

What  did  you  give  Jones  on  Performance  Factor  1:  Technical  Knowledge/ Ski 11? 


ALLOW  TIME  FOR  MEMBERS  IN  THE  GROUP  TO  ANSWER. 

TORN  ON  OVERHEAD  PROJECTC® 

SHOW  SLIDE  #19 

The  appropriate  rating  would  be  a  4  on  this  factor  because  the  first  paragraph 
states  that  Jones  was  allowed  to  work  virtually  unsupervised.  That  statement 
corresponds  to  the  behavioral  example  of  level  4.  Any  questions? 

What  rating  did  you  give  Jones  on  Performance  Factor  2:  Initiative/Effort? 

SHOW  SLIDE  #20 

The  appropriate  rating  would  be  a  5.  The  second  paragraph  states:  He 
volunteered  to  remain  in  order  to  offer  any  support  and/or  fill  in  if 
necessary .  Any  questions? 

"What  rating  did  you  give  Jones  on  Performance  Factor  3;  Knowledge  of  and 
Adherence  to  Regulations/Orders?" 

SHOW  SLIIS  #21 

The  appropriate  rating  would  be  a  2.  Tl:»  fourth  paragraph  states:  He  has 
failed  to  present  himself  for  periodic  weigh-ins.  Any  questions? 

What  rating  did  you  give  Jones  on  Performance  Factor  7:  Self-Development? 


59 


SHOW  SLIIB  «22 


The  appropriate  rating  would  be  a  3.  The  third  paragraph  states:  He  has 
chosen  not  to  push  himself  and  sinply  wants  to  ccnplete  the  course 
requirements  in  the  prescribed  time. 


VII.  TIPS  ON  MRKING  ACCURATE  RATINGS 
A.  GE3«E3»L  INFQRMATIGN 

The  most  inportant  thing  to  remember  when  making  your  ratings  is  to  focus  your 
atcention  only  on  the  person  you  are  rating  and  only  on  the  person's  ability 
to  perform.  Avoid  comparing  the  person  with  co-workers  you've  rated 
previously  or  those  you  will  be  evaluating  later.  Remember  that  even  though 
you  and  the  people  you  rate  are  similar  because  you  are  all  Aircrew  Life 
Support  Specialists,  each  person  has  a  unique  set  of  strengths  and  weaknesses. 
Also,  be  aware  that  poor  or  outstanding  performance  in  one  area  does  not 
dictate  the  quality  of  performance  in  other  areas.  Rate  the  person  according 
to  the  individual's  ability  to  perform  on  the  job  and  focus  on  behavior  that 
you  can  see.  If  you  encounter  a  task  you  haven't  seen  the  person  perform, 
base  your  rating  on  the  behavior  you  have  observed  and  give  your  best  estimate 
of  the  person's  ability  on  that  task.  He  are  also  collecting  task  experience 
information  and  we  will  be  able  to  tell  which  tasks  are  seldom  or  never 
performed  by  the  individual.  Finally,  do  not  be  afraid  to  use  the  entire 
range  of  the  scale  when  appropriate.  Your  honesty  will  serve  to  ensure  the 
accuracy  of  your  ratings.  Are  there  any  questions? 


PROCTC»  SCRIPT  PCR  RATING  PC»M  ANSHER  SHEET  INSTRUCTION 

NOTE:  HAND  OUT  RATING  FORM  ANSHER  SHEETS.  CALL  EACH  RATER  TO  THE  FRONT  AND 
GIVE  THEM  THEIR  SET  OF  ANSHER  SHEETS,  EXPLAINING  HHO  THEY  HILL  RATE.  ALSO 
PROVIDE  THE  GENERAL  BACKGROUND  SHEET  FOR  ITEMS  1-7. 


SHOW  OVERHEAD  OF  ANSHER  SHEET  (SLIDE  #23) 

Before  you  begin  filling  out  the  rating  forms,  I'd  like  to  take  a  few  minutes 
to  explain  the  answer  sheet  to  you.  Please  look  at  side  one  of  the  Rating 
Form  Answer  Sheet.  On  the  left  hand  side  of  the  answer  sheet  are  four  blocks 
where  you  will  record  your  ratings.  Starting  at  the  top  of  the  answer  sheet 
is  the  Global  Rating  Form.  Record  your  responses  to  the  two  items  on  the 
Global  Rating  Form  here.  Below  the  Global  Rating  Form  is  the  Air-Force  Hide 
Rating  Form.  Record  your  responses  to  the  eight  items  on  the  Air-Force  Hide 
Rating  Form  here.  Next  is  the  Dimensional  Rating  Form.  This  specialty  has  6 
dimensions,  so  on  the  answer  sheet  you  will  only  use  Dimensions  1  through  6. 
Leave  the  others  blank.  Below  the  Dimensional  Rating  Form  is  the  Task  Rating 
Form.  You  will  not  use  all  60  items  in  the  Task  Rating  Form  Area  on  the 
Answer  Sheet.  Each  functional  area  has  28  items  for  the  Task  Rating  Form,  so 
you  will  only  use  those  nurbers  that  are  necessary  on  the  Rating  Form  Axiswer 
Sheet. 
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Be  careful  as  you  proceed  from  one  set  of  rating  forms  to  the  next  on  the 
answer  sheet.  The  forms  are  not  in  the  same  order  on  the  answer  sheet  as  they 
appear  in  your  rating  form  book.  For  exanf>le,  the  Air  Force-Wide  Rating  Form 
is  second  on  the  answer  sheet  but  fourth  in  your  rating  form  book.  Be  sure  to 
find  the  correct  section  on  the  answer  sheet  before  you  begin  to  conplete  a 
grov^  of  rating  forms.  Please  follow  the  order  of  forms  that  you  find  in  the 
books. 

On  the  right-hand  side  of  the  Answer  Sheet  is  the  area  for  biographical  data. 
As  you  can  see,  we've  filled  in  some  of  the  information  for  you.  For  example, 
at  the  top  of  the  page,  in  the  area  labeled  "Last  Name  and  SSAN  of  Person 
Being  Rated,"  we  printed  the  Last  Name  and  Social  Security  Nunrber  of  the 
person  you  will  be  rating.  It  is  this  person  (either  yourself,  a  co-worker, 
or  your  subordinate)  that  this  sheet  of  ratings  will  be  based  on. 

Looking  over  the  lower  portion  of  the  same  page,  you  will  notice  several  other 
information  blocks.  There  is  an  area  labeled  "Base  Code,  Eval.  Code,  AFS 
Code,  Phase  Info.,  and  Skill  Level."  He  have  already  completed  all  but  the 
skill  level.  Please  enter  your  skill  level  in  the  appropriate  blank  and 
blacken  the  corresponding  oval . 

Below  that  area  is  a  data  field  with  the  title  "Your  Name  and  SSRN.  "As  you 
can  see,  we  printed  your  Name  and  Social  Security  Nunnber  in  the  blocks. 

Please  check  this  information  to  make  sure  it  is  correct.  If  we've  misspelled 
your  name,  erase  the  mistake  and  enter  the  correct  spelling.  Do  the  same 
thing  for  your  social  security  nunber.  Once  you've  corrected  any  mistakes,  go 
ahead  and  blacken  the  ovals  that  correspond  to  the  printed  letters  in  your 
name,  or  the  printed  nunnibers  of  your  social  security  nvmber. 

Below  and  to  the  right  of  the  area  labeled  "Your  Name  and  SSAN,"  is  a  block 
for  the  date.  Today's  date  is  already  in  the  appropriate  blocks. 

Please  turn  the  answer  sheet  over.  On  side  two,  we've  provided  space  for  you 
to  record  responses  to  the  questionnaires  that  you  will  complete  once  you've 
finished  responding  to  the  rating  forms.  The  first  two  questionnaires  —  The 
General  Background  Questionnaire  and  the  Rating  Form  Questionnaire  are 
completed  by  everyone.  If  you  are  rating  more  than  one  person,  you  will  only 
complete  these  questionnaires  once.  One  thing  I  need  to  mention  regarding  the 
General  Background  Questionnaire  is  that  you  will  not  record  all  your 
responses  to  this  questionnaire  on  the  Rating  Form  Answer  Sheet.  Page  1  of 
the  General  Background  Questionnaire  asks  very  specific  questions  that  cannot 
be  answered  by  using  the  5-point  scale  on  the  answer  sheet.  Because  of  this, 
you  need  to  write  your  responses  to  questions  1  through  7  on  the  pull-out 
sheet  of  the  questionnaire  itself.  Be  svire  that  your  name  and  SSAN  is  on  that 
sheet.  Then,  beginning  with  questicxi  8,  you  will  record  your  responses  on  the 
Rating  Form  Answer  Sheet.  Leave  items  1  through  7  on  the  Rating  Form  Answer 
Sheet  blank.  Are  there  any  questions  about  this? 


NC3TE:  ANSWER  ANY  QUESTIONS  THE  RATERS  HAVE 
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If  you  find  that  you  have  q[uesticns  when  you  get  to  the  General  Background 
Questionnaire,  please  raise  your  hand  and  I'll  be  glad  to  help  you. 

Answers  to  all  items  on  the  Rating  Form  Questionnaire  can  be  recorded  on  the 
answer  sheet.  Wnen  recording  your  responses,  make  sure  you  match  the  question 
nvmber  in  the  booklet  to  the  cor''e'^  ntxiber  on  the  answer  sheet. 

To  the  right  of  the  Rating  Form  Questionnaire  is  the  Task  Experience  Ratings 
data  field.  This  information  block  should  be  ccnpleted  ONLY  by  those  of  you 
vdio  are  rating  yourselves  using  the  rating  forms.  That  is  why  the 
instructions  above  the  title  "Task  Experience  Ratings,"  read  "To  Be  Filled  Out 
By  Incvitibent  Only."  The  term  "inoirbent"  refers  to  the  first-termers  that 
will  be  going  through  the  Walk  Through  Performance  Test.  Those  of  you  who 
will  be  doing  the  Walk  Through,  please  complete  this  section  on  your  "Self" 
rating  form. 

I  have  a  few  closing  remarks  co  make  before  you  begin  filling  out  your  rating 
forms.  First,  please  use  the  number  2  pencils  that  I  have  handed  out  to  mark 
the  Rating  Form  Answer  Sheet.  In  addition,  be  sure  that  all  your  answer  marks 
are  heavy  and  that  you  blacken  the  oval  shaped  space  only.  Erase  all  changes 
completely,  being  careful  not  to  tear  the  answer  sheet.  If  you  do  tear  the 
answer  sheet,  please  let  me  know  and  I'll  give  you  a  new  answer  sheet  to  fill 
out.  Make  sure  that  you  erase  all  stray  pencil  marks  that  you  might  make  when 
filling  out  the  answer  sheet.  Stray  marks  will  confuse  our  optical  scanner 
and  jeopardize  the  scanning  of  the  answer  sheet.  Make  sure  to  mark  only  one 
answer  to  each  questicn  on  the  answer  sheet.  Be  sure  to  mark  your  answers 
carefully  so  that  you  enter  your  response  in  the  appropriate  space  on  the 
answer  sheet.  Do  not  staple,  fold,  or  otherwise  damage  the  answer  sheet. 

When  you  finish  filling  out  your  answer  sheet,  please  look  it  over  carefully 
to  make  sure  you  have  not  left  anything  out.  Once  you  are  satisfied  that  all 
your  answer  sheets  are  complete,  please  give  both  the  Answer  Sheets  and  your 
Rating  Form  Booklet  to  me. 

Remember,  if  you  have  ANY  questions  about  the  answer  sheet  or  how  to  fill  it 
out,  please  ask  me. 


SHOW  SLIDE  #24  -  RATING  FC»M  CHECaOilST 


VIII.  OONCLUSION 

New  that  you  have  become  familiar  with  the  rating  forms  and  answer  sheet  and 
have  practiced  making  ratings,  you  are  ready  to  begin  using  the  forms  to  rate 
your  performance  or  the  performance  of  your  co-workers  or  siabordinates .  Try 
to  make  the  most  accurate  ratings  possible,  keeping  in  mind  the  tips  that  were 
discussed  during  this  training  session.  Remember  that  the  information 
collected  on  the  rating  forms  will  be  used  for  research  purposes  only.  It 
will  not  go  into  anyone's  records  or  be  seen  by  persons  other  than  research 
personnel.  Please  read  all  instructi*..ns  carefully.  Start  with  the  General 
Instructions  on  page  11  arid  then  go  on  to  the  Global  Rating  Form  on  page  12. 
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Also,  please  feel  free  to  ask  me  questions.  Just  raise  your  hand  and  I'll 
stop  by. 

NOTE  TO  PROCTORS:  ONCE  THE  SUBJECTS  BEGIN  FILLING  OUT  IHE  RATING  FORMS, 
BE  ATTENTIVE.  SOMETIMES  PEOPLE  WILL  NOT  ASK  A  QUESTION  THET  THINK  IS 
’•stupid."  ip  you  SEE  any  CONFUSED  ESffRESSIONS,  DCW'T  WAIT  FOR  THAT 
PERSON  TO  ASK  A  QUESTION,  GO  AND  ASK  THEM  IF  THEY  NEH)  HELP.  WHEN 
SUBJECTS  FINISH  FILLING  OUT  AN  ANSWER  SHEET  AND  HAND  IT  TO  YOU,  HAVE 
THEM  WAIT  WHILE  YOU  CHECK  IT.  ONCE  YOU  ARE  SURE  THEY  HAVE  NOT  LEFT  OUT 
ANY  INFORMATIC»l,  THANK  THEM  FOR  THEIR  TIME  AND  DISMISS  THEM. 
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lOTDIS  FORi  CSBCKLIST 


Side  One: 

(1)  Blacken  the  appropriate  ovals  in  the  area  labeled  "Last  Name  and  SSAN  of 
Person  Being  Rated." 

(2)  Blacken  the  appropriate  ovals  in  the  area  labeled  "Base  Code,  Eval. 

Code,  APS  Code,  Phase  Info,  and  Skill  Level."  Print  your  current  skill 
level  in  the  "Skill  Level"  colxxm,  and  blacken  the  corresponding  oval. 

(3)  Blacken  the  apprc^riate  ovals  in  the  area  "Your  Name  and  SSAN"  after 
checking  for,  and  correcting  mistakes. 

(4)  Print  today's  date  in  the  blocks  below  the  title,  "Date."  Blackai  the 
corresponding  ovals. 

(5)  Complete  the  Global  Rating  Form.  (2  items) 

(6)  Complete  the  Air  Force-Wide  Rating  Form.  (8  performance  factors) 

(7)  Complete  the  Dimerxsional  Rating  Form.  (Dimensions  1-6  only) 

(8)  Complete  the  Task  Rating  Form. 


Side  Two: 

(9)  Complete  these  questionnaires  only  one  time.  Complete  the  General 
Background  Questionnaire.  Write  your  responses  to  Questions  1-7  on  the 
pull-out  sheet.  Record  your  responses  to  Questions  8-23  on  the  Rating 
Form  Answer  Sheet,  starting  with  ntnber  8. 

(10)  Complete  the  Rating  Form  Questionnaire. 

(11)  Task  Experience  Ratings  -  TO  BE  CCHPLETED  ONLY  BY  PERSONS  WHO  HAVE 

BEEN  RATING  IHEM^VES 

-  if  you  do  not  know  if  you  should  complete  this  questionnaire  -  ASK. 

(12)  Check  your  answer  sheet  before  handing  it  in  to  make  sure  you  have 
completed  it  properly. 
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Slide  #2 
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Slide  #3 


JOB  PERFORMANCE  MEASUREMENT 


68 


Slide  #4 


DATA  COLLECTION  SCHEDULE 
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Slide  #5 


AIR  FORCE  PAYOFFS 
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Slide  #6 
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Slide  #7 


RATING  FORMS 
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Slide  #8 


RATING  SCALE 
PROFICIENCY  BASE 
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Slide  #9 


COMPLETING  THE  ANSWER  SHEET 
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Slide  #10 


Dimension  1:  Administration 

The  accurate  preparation  and  maintenance  of  facility  operating  forms, 
publications,  records,  charts,  etc.  Scheduling,  supplying,  and 
coordinating  with  other  agencies.  Examples;  Direct  Issuance  of 
equipment;  schedule  maintenance  or  repair  of  life  support  equipment. 


level  Ratin 

Always  exceeds  5 

acceptable  level 
of  proficiency 


Frequently  exceeds  4 

acceptable  level 
of  proficiency 


Meets  acceptable  3 

level  of 

proficiency 


Occasionally  meets  2 

acceptable  level 
of  proficiency 


Never  meets  1 

acceptable  level 
of  proficiency 


Behavioral  Examples 

Consistently  performs  all  admin¬ 
istrative  tasks  accurately,  com¬ 
pletely,  and  legibly;  rarely  needs 
to  be  directed,  consistently  dis¬ 
plays  Initiative;  consistently 
completes  tasks  In  a  timely  manner. 

Usually  performs  all  administra¬ 
tive  tasks  accurately,  complete¬ 
ly,  and  legibly;  seldom  needs  to 
be  directed;  usually  displays  In¬ 
itiative;  usually  completes  tasks  In 
a  timely  manner. 

Performs  all  administrative  tasks 
acceptably;  sometimes  needs  to  be 
directed;  sometimes  displays  Ini¬ 
tiative;  completes  tasks  In  a  timely 
manner. 

Occasionally  performs  administra¬ 
tive  tasks  acceptably;  usually 
needs  to  be  directed;  seldom  dis¬ 
plays  Initiative;  seldom  completes 
tasks  In  a  timely  manner. 

Rarely  performs  administrative 
tasks  acceptably;  consistently 
needs  to  be  directed;  rarely  dis¬ 
plays  Initiative;  rarely  completes 
tasks  In  a  timely  manner. 

Slide  #11 
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RATING  FORM  ANSWER  SHEET 


global 

RATING 

FORM 


TECHNICAL  PROFIOENCY 


INTERPERSONAL  PROFIOENCY 


AIR  FORCE-WIdSNaTING  FORM 


PERFORMANCE  FACTOR  1;  Ttehnical  Knowtad^t/Sklll 
PERFORMANCE  FACTOR  £  IntllaItvft/EncKi 
PERFORMANCE  FACTOR  3;  Knowtodo*  of  RsgulaikKM 
PERFORMANCE  FACTOR  4.  Inlagrtty 
PERFORMANCE  FACTOR  S:  L««d«rthtp 
PERFORMANCE  FACTOR  «;  MillUry  Appwtnot 
PERFORMANCE  FACTOR  7:  S«lf  Oavtlopmanl 
PERFORMANCE  FACTOR  •:  $«H  Control 
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Dimension  1:  Administration 

The  accurate  preparation  and  maintenance  of  facility  operating  forms, 
publications,  records,  charts,  etc.  Scheduling,  supplying,  and 
coordinating  with  other  agencies.  Examples;  Direct  Issuance  of 
equipment;  schedule  maintenance  or  repair  of  life  support  equipment. 


Level  Rating 

Always  exceeds  5 

acceptable  level 
of  proficiency 


Frenuently  exceeds 
acc  3tab1e  levei 
of  proficiency 


Meets  acceptable  3 

level  of 

proficiency 


Occasionally  meets  2 

acceptable  level 
of  proficiency 


Never  meets  1 

acceptable  level 
of  proficiency 


Behavioral  Examples 


Consistently  performs  all  admin¬ 
istrative  tasks  accurately,  com¬ 
pletely,  and  legibly;  rarely  needs 
to  be  directed,  consistently  dis¬ 
plays  Initiative;  consistently 
completes  tasks  in  a  timely  manner. 

Usually  performs  all  administra¬ 
tive  tasks  accurately,  complete¬ 
ly,  and  legibly;  seldom  needs  to 
be  directed;  usually  displays  In-  . 
Itlative;  usually  completes  tasks  In 
a  timely  manner. 

Performs  all  administrative  tasks 
acceptably;  sometimes  needs  to  be 
directed;  sometimes  displays  Ini¬ 
tiative;  completes  tasks  In  a  timely 
manner. 

Occasionally  performs  administra¬ 
tive  tasks  acceptably;  usually 
needs  to  be  directed;  seldom  dis¬ 
plays  Initiative;  seldom  completes 
tasks  In  a  timely  manner. 

Rarely  performs  administrative 
tasks  acceptably;  consistently 
needs  to  be  directed;  rarely  dis¬ 
plays  Initiative;  rarelj  completes 
tasks  In  a  timely  manner. 
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Dimension  2.  Helmets  end  Oxygen  Masks 

The  pouring  and  fabrication  of  helmet  liners  and  the  sizing  and  fitting 
of  he^niets  and  oxygen  masks.  Inspecting,  assembling,  cleaning  and 
trouble-shooting.  Examples;  Perform  helmet  periodic  Inspections;  adjust 
oxygen  masks. 


Level  Rating 

Always  exceeds 
acceptable  level 
of  proficiency 


Frequently  exceeds  4 

acceptable  level 
of  proficiency 


Meets  acceptable  3 

level  of 

proficiency 


Occasionally  meets  2 

acceptable  level 
of  proficiency 


Never  meets  1 

acceptable  level 
of  proficiency 


Behavioral  Examples 

Always  Inspects  and  performs 
required  maintenance  on  the 
equipment  acceptably:  able  to 
troubleshoot  without  supervision; 
consistently  Identifies  all 
equipment  malfunctions;  able  to  use 
Innovative  techniques  to  Improve  on 
established  procedures. 

Usually  Inspects  and  performs 
required  maintenance  on  the 
equipment  acceptably;  able  to 
troubleshoot  with  minimum 
supervision;  frequently  Identifies 
equipment  malfunctions;  sometimes 
uses  Innovative  techniques  to 
Improve  on  established  procedures. 

Sometimes  Inspects  and  performs 
required  maintenance  on  the 
equipment  acceptably:  sometimes 
needs  supervision  when  trouble¬ 
shooting;  sometimes  Identifies 
equipment  malfunctions;  seldom  uses 
Innovative  techniques  to  improve  on 
established  procedures. 

Occasionally  Inspects  and  performs 
required  maintenance  on  the  equip¬ 
ment  acceptably;  usually  needs 
supervision  when  troubleshooting; 
occasionally  Identifies  equipment 
malfunctions;  rarely  uses  Inno¬ 
vative  techniques  to  Improve  on 
established  procedures. 

Rarely  Inspects  and  performs  re¬ 
quired  maintenance  on  the  equipment 
acceptably;  Is  unable  to  trouble¬ 
shoot  without  supervision;  rarely 
Identifies  equipment  malfunctions; 
Is  unable  to  use  Innovative  tech¬ 
niques  to  Improve  on  established 
procedures. 
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Dimension  4:  Aircrew  Clothing 

The  sizing,  fitting,  and  Inspection  of  aircrew  clothing.  Cleaning  and 
repairing  aircrew  clothing.  EKamples:  Perform  ant1-6  suit  periodic 
Inspections;  coordinate  alterations  on  aircrew  clothing  with  other 
facilities. 


Itvel  Dating 

Always  exceeds  S 

acceptable  level 
of  proficiency 


Frequently  exceeds  4 

acceptable  level 
of  proficiency 


Meets  acceptable  3 

level  of 

proficiency 


Occasionally  meets 
acceptable  level 
of  proficiency 


Never  meets  1 

acceptable  level 
of  proficiency 


Behavioral  Examples 

Consistently  Is  able  to  size  and 
fit  aircrew  members  without  the 
need  for  future  fittings;  Is  able 
to  Inspect  and  repair  aircrew 
aircrew  clothing  with  no  super¬ 
vision;  consistently  suggests  new 
techniques  for  modifying  aircrew 
clothing  and  storing  equipment. 

Usually  Is  able  to  size  and  fit 
aircrew  members  without  the  need 
for  future  fittings;  Is  able  to 
Inspect  and  repair  aircrew  clothing 
with  little  supervision;  frequently 
suggests  new  techniques  ^or 
modifying  aircrew  clothing  and 
storing  equipment. 

Sometimes  Is  able  to  size  and 
fit  aircrew  members  without  the 
need  for  future  fittings;  needs  some 
supervision  while  Inspecting  and 
repairing  aircrew  clothing;  some¬ 
times  suggests  new  techniques  for 
modifying  aircrew  clothing  and 
storing  equipment. 

Rarely  1s  able  to  size  and  fit 
aircrew  members  without  the  need 
for  future  fittings;  usually  needs 
supervision  while  Inspecting  and 
repairing  aircrew  clothing;  rarely 
suggests  new  techniques  for  mod¬ 
ifying  aircrew  clothing  and  storing 
equipment. 

Is  unable  to  size  and  fit  aircrew 
members  without  the  need  for  future 
fittings;  always  needs  supervision 
while  Inspecting  and  repairing  air¬ 
crew  clothing;  never  suggests  new 
techniques  for  modifying  aircrew 
clothing  and  storing  equipment. 
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Dimension  6:  Training  and  Instruction 


The  demonstration  and  Instruction  of  life  support  equipment  functions  and 
uses.  Scheduling,  Instructing,  demonstrating,  and  briefing.  Examples: 
Construct  training  aids;  brief  parachute  safety. 


Level 

Ratinq 

Behavioral  Examples 

Always  exceeds 
acceptable  level 
of  proficiency 

5 

Consistently  performs  all  aspects 
of  training  effectively;  always 
Instructs  and  briefs  In  a  thoroughly 
professional  manner;  schedules  and 
conducts  training  with  no  super^ 
vision. 

Frequently  exceeds 
acceptable  level 
of  proficiency 

4 

Usually  performs  all  aspects 
of  training  effectively;  usually 
Instructs  and  briefs  In  a  pro¬ 
fessional  manner;  schedules  and 
conducts  training  with  little 
supervision. 

Meets  acceptable 
level  of 
proficiency 

© 

Usually  performs  some  aspects  of 
training  effectively;  sometimes 
Instructs  and  briefs  In  a  pro¬ 
fessional  manner;  occasionally  needs 
some  supervision  to  schedule  and 
conduct  training. 

Occasionally  meets 
acceptable  level 
of  proficiency 

2 

Occasionally  performs  some  as¬ 
pects  of  training  effectively; 
seldom  Instructs  and  briefs  In  a 
professional  manner;  usually  needs 
some  supervision  to  schedule  and 
conduct  training. 

Never  meets 
acceptable  level 
of  proficiency 

1 

Rarely  performs  any  aspects  of 
training  effectively;  never 

Instructs  or  briefs  In  a  pro¬ 
fessional  manner;  always  needs 
supervision  to  schedule  and  conduct 
training. 
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RATING  SCALE 
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NEVER  MEETS  ACCEPTABLE  LEVEL  OF 
PERFORMANCE 


Performance  Factor  5:  Leadership 

Performing  In  a  leader  role,  as  required,  and  providing  support  for  fellow 
unit  members. 


level 


Rating  Behavioral  Examples 


Always  exceeds  S 

acceptable  level 
of  performance 


Frequently  exceeds  4 

acceptable  level 
of  performance 


Meets  acceptable  3 

level  of 

performance 


Occasionally  meets  2 

acceptable  level 
of  performance 


Never  meets  1 

acceptable  level 
of  performance 


Performs  very  effectively  when  placed 
In  leadership  position;  takes  charge 
when  necessary  and  fills  In  effec¬ 
tively  for  supervisor;  Is  sought  out 
as  resource  person  and  serves  as  role 
model;  always  looks  out  for  and 
supports  fellow  unit  members  when 
they  are  In  trouble,  needs  encourage¬ 
ment,  performing  poorly,  etc. 

Performs  effectively  In  most  leader¬ 
ship  situations;  usually  looks  out 
for  and  supports  fellow  unit  members 
when  they  are  In  trouble,  need 
encouragement,  performing  poorly, 
etc. 

Performs  effectively  In  structured 
leadership  situations  and  less  well 
In  difficult  situations  requiring 
hard  Judgments,  and  quick  decis¬ 
ions;  Is  supportive  of  fellow  unit 
members  at  Important  times. 

Seldom  effective  in  leadership  posi¬ 
tions;  will  not  go  out  of  way  to 
provide  support  encouragement,  etc., 
to  fellow  unit  members;  reluctant  to 
help  others  complete  their 
assignments. 

Unable  to  perform  In  leadership 
positions;  unable  to  step  In  and 
take  charge  even  when  necessary; 
unwilling  to  provide  support,  en¬ 
couragement,  etc.,  to  fellow  unit 
members;  shows  Impatience  and  Insen¬ 
sitivity  to  other  unit  personnel. 
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Performance  Factor  1:  Technical  ICnowledge/Sklll 


Displaying  Job  knowledge  and  skill. 


Level 


Rating  Behavioral  Examples 


Always  exceeds  S 

acceptable  level 
of  performance 


Frequently  exceeds 
acceptable  level 
of  performance 


Meets  acceptable  3 

level  of 

performance 


Occasionally  meets  2 

acceptable  level 
of  performance 


Never  meets  1 

acceptable  level 
of  performance 


Displays  exceptional  knowledge/skill 
to  consistently  complete  assignments 
and  tasks  properly;  requires  little 
or  no  supervision;  completes  tasks  In 
minimum  time. 

Displays  considerable  knowledge  and 
skill  to  complete  assignments  and 
tasks  properly;  performs  effectively 
with  little  supervision;  completes 
tasks  quicker  than  the  average  first- 
term  airman. 

Displays  good  knowledge/skill  In 
most  aspects  of  the  Job;  able  to 
properly  complete  the  majority  of 
tasks;  requires  supervision  only  on 
difficult  tasks  and  assignments;  com¬ 
pletes  work  In  the  same  time  as 
other  first-term  airmen. 

Occasionally  displays  adequate  knowl¬ 
edge  about  how  to  complete  tasks  and 
assignments;  quality  of  work  Is  In¬ 
consistent;  requires  direct 
supervision  on  most  tasks  to  ensure 
quality  and  accuracy;  usually  com¬ 
pletes  tasks  within  required  time. 

Does  not  display  knowledge  and  skill 
necessary  to  properly  complete  tasks 
and  assignments;  unable  to  perform 
without  direct  supervision;  often 
falls  to  complete  assignments;  per¬ 
forms  slower  than  other  first  term 
airmen. 
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Performance  Factor  2:  Initiative/Effort 


Showing  initiative 


Level 


Always  exceeds 
acceptable  level 
of  performance 


Frequently  exceeds 
acceptable  level 
of  performance 


Meets  acceptable 
level  of 
performance 


Occasionally  meets 
acceptable  level 
of  performance 


Never  meets 
acceptable  level 
of  performance 


and  extra  effort  on  job/misslon/assignment. 


Rating  Behavioral  Examples 

Always  volunteers  when  opportunities 
arise;  demonstrates  initiative 
promptly  and  effectively;  enthusi¬ 
astically  works  extra  hours  to 
ensure  completion  of  project;  works 
to  completion  when  situation  becomes 
difficult. 

4  Frequently  volunteers  and  demon¬ 

strates  initiative  when  opportunities 
arise;  usually  performs  with  en¬ 
thusiasm  despite  difficulty;  willing 
to  work  extra  hours  to  complete 
assignment. 

3  Volunteers  for  some  assignments; 

willing  to  put  in  extra  effort  and 
time  of  priority  tasks;  does  not 
give  up  easily  when  faced  with 
obstacles  or  difficulty. 

2  Seldom  volunteers  or  displays  initi¬ 

ative;  may  avoid  difficult  assign¬ 
ments;  has  a  tendency  to  stop  working 
when  tired  or  bored;  will  work  extra 
hours  only  when  required. 

1  Displays  no  initiative  and  never 

volunteers  for  assignments;  reluctant 
to  work  extra  hours;  may  become  hos¬ 
tile  when  asked  to  put  forth  extra 
effort;  performs  ineffectivly  due  to 
lack  of  effort;  gives  up  easily  when 
faced  with  a  difficult  task. 
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Performance  Factor  3:  Knowledge  of  and  Adherence  to  Regulations/ 

Orders 

Displaying  knowledge  of  and  adherence  to  Air  Force  (AF)/un1t  rules, 
regulations  and  orders  and  displaying  respect  for  authority. 


Level 


Rating  Behavioral  Examples 


Always  exceeds  5 

acceptable  level 
of  performance 


Frequently  exceeds  4 

acceptable  level 
of  performance 


Meets  acceptable  3 

level  of 

performance 


Occasionally  meets 
acceptable  level 
of  performance 


Never  meets  1 

acceptable  level 
of  performance 


Demonstrates  an  exceptional  knowl¬ 
edge  and  understanding  of  AF/unIt 
rules  and  regulations.  Follows 
spirit  as  well  as  the  letter  of 
rules  and  regulations;  obeys  orders 
quickly;  always  reports  promptly  for 
duty,  formations,  appointments,  etc.; 
remains  alert  while  on  duty  even  when 
It  Is  Inconvenient  to  do  so. 

Demonstrates  an  excellent  knowl¬ 
edge  and  understanding  of  AF/unIt 
rules  and  regulations;  always  obeys 
orders  without  fall;  can  be  counted 
on  to  be  at  appointed  area  on  time; 
displays  appropriate  respect  for 
authority. 

Follows  AF/unIt  rules  and  regulations 
almost  without  fall;  Is  knowledgeable 
of  those  rules  and  regulations  that 
concern  safety  or  security;  rarely 
late  for  duty  or  formation;  never 
leaves  assigned  duty  section,  always 
obeys  orders. 

Oc'^aslonally  may  fall  to  follow  AF 
rules  or  regulations;  occasionally 
late  for  duty  formations;  usually 
obeys  orders  but  may  question  them. 

Ignores  or  falls  to  follow  AF/unIt 
rules,  regulations  or  orders;  often 
displays  lack  of  respect  toward 
superiors;  may  leave  assigned  work 
area. 
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Perfonnance  Factor  7:  ScU  Development 


Developing  job-related  skills. 


Level 


Rating  Behavioral  Examples 


Always  exceeds  5 

acceptable  level 
of  performance 


Frequently  exceeds  4 

acceptable  level 
of  performance 


Meets  acceptable 
level  of 
performance 


Occasionally  meets  2 

acceptable  level 
of  performance 


Never  meets  1 

acceptable  level 
of  performance 


Devotes  a  substantial  amount  of  off- 
duty  time  to  studying  and  practicing 
to  become  as  proficient  as  possible 
in  Important  Job-related  skills;  en¬ 
thusiastically  takes  on  additional 
job  duties  and  responsibilities  to 
prepare  for  promotion;  actively  seeks 
out  opportunities  for  self-improve¬ 
ment;  completes  Career  Development 
Course  (CDC)  requirements  In  less 
than  prescribed  time,  and  consis¬ 
tently  obtains  above-average  scores 
in  CDC  volumes. 

Studies  and  practices  during  off-duty 
hours  to  improve  job-related  skills: 
takes  advantage  of  most  opportunities 
presented  to  take  on  additional  re¬ 
sponsibility  that  would  help  prepare 
for  promotion;  completes  CDC  require¬ 
ments  in  less  than  required  time. 

Is  aware  of  personal  weaknesses  in 
Job-related  skills  and  participates 
in  training  programs  to  Improve  these 
areas;  sometimes  reluctant  to  take  on 
extra  responsibility  that  would  help 
prepare  for  promotion;  completes  CDC 
requirements  within  prescribed  time. 

Participates  half-heartedly  without 
seriously  applied  effort  in  training 
programs:  studies  manuals  or  prac¬ 
tices  to  improve  job  skills  only  when 
ordered  to  do  so;  avoids  additional 
responsibility  that  might  help  pre¬ 
pare  for  promotion;  may  require  re¬ 
testing  to  fulfill  CDC  requirements. 

Does  not  participate  in  training  pro¬ 
grams;  makes  no  effort  to  improve  be¬ 
low  standard  job  skills;  fails  CDC 
requirements  due  to  lack  of  Interest, 
effort,  or  attention. 
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COMPLETING  THE  RATING 
FORMS/QUESTIONNAIRES 
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COMPLETE  ONLY  ONE  TIME 
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PRIVACY  ACT  STATEMENT 

In  accordance  with  the  Air  Force  Privacy  Act  Program,  AFR  12-35,  paragraph  8, 
the  following  information  about  this  svurvey  is  provided: 

a.  Authority.  10  U.S.C.,  8012,  Secretary  of  the  Air  Force:  Powers 
and  Duties  Delegation  by. 

b.  Principal  Purpose.  The  data  collected  are  to  be  used  for  research 
purposes  only. 

c.  Routine  Use.  Tbe  information  collected  will  be  used  by  the  Air 
Force  Hunnan  Resoturces  Laboratory  in  a  research  study  to  link  job  performance 
with  enlistment  standards. 

d.  Participation  in  this  survey  is  entirely  voluntary. 

e.  No  adverse  action  of  any  kind  nay  be  taken  against  any  individual 
tdio  elects  not  to  participate  in  this  survey. 
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RATING  ERRORS  BtERCISE 

Tlie  follcMlng  is  a  conversation  between  several  shift  supervisors.  Some  of 

their  comnents  sviggest  certain  biases  they  have  when  imking  ratings.  Try  to 

identify  the  biases  as  we  read  the  conversation. 

Andrews:  Here  we  are  agaiin  at  our  weekly  gripe  session. 

Baker:  Yeah.  Seems  like  we  never  nm  out  of  problems  to  complain  about. 

Cullen:  I  don't  know  tdiy  you  people  have  so  many  problems  on  your  shift. 

Baker:  Because  we  don't  have  the  "cream  of  the  crop"  that  you  have. 

Cullen:  You've  got  the  same  kind  of  people  working  for  you  that  I  have. 

Just  think  about  it.  All  the  airmen  take  tests  to  identify  who 
has  the  aptitude  for  fdiat.  Right? 

Andrews :  Right . 

Cullen:  OK.  So  you've  got  a  bunch  of  people  with  an  aptitude  for  Life 

Support.  These  recruits  all  receive  the  same  training  at  tech 
school  to  learn  to  be  ccmpetent.  They  all  cone  out  of  Chanute 
with  the  same  training.  So  there  shouldn't  be  anyone  on  your 
shift  who  is  more  qualified  to  do  the  job  than  someone  else. 

Sure,  if  you  take  any  one  of  the  3-levels  and  compare  that  person 
to  the  average  person  on  the  street,  he's  going  to  look  like  a 
genius.  But  among  his  fellow  workers,  he's  just  another  average 
guy  like  all  the  rest. 

Andrews:  I  disagree.  On  my  shift,  I've  got  a  couple  of  people  who  are  just 

outstanding.  Next  to  these  airmen,  the  rest  of  my  people  are  way 
below  average. 

Baker:  I  know  what  you  mean.  I  received  a  new  airman  two  weeks  ago.  You 

wouldn't  believe  how  badly  that  person  has  performed  in  the  short 
time  on  the  job.  I  guess  I've  got  a  real  loser  on  ny  hands. 

Davis:  Let  me  tell  you  about  the  last  recruit  that  came  onto  ny  shift. 

She  was  fresh  out  of  Chanute.  She  hadn't  been  here  but  a  couple 
of  weeks  and  I  gave  her  a  C80  mask  to  inspect.  Well,  she  did  the 
complete  inspection  like  a  pro.  The  QC  guy  couldn't  find  a  thing 
wrong  with  it.  I  think  I  have  a  super  recruit  in  this  person.  I 
mean,  if  she  can  do  that,  she  cam  do  just  about  auiything  I  assign 
her  to  do. 

Andrews:  You  know,  Cullen,  I've  heard  how  difficult  you  can  be  when  you 

rate  your  airmen.  I've  heard  seme  of  your  people  complain  that  no 
matter  how  hard  they  try,  you  won't  give  them  more  than  an  average 
rating.  They  say  they  feel  like  they're  beating  their  heads 
against  a  brick  wall. 
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Cullen: 

Andrews: 


Davis: 

Andrews: 

Davis: 


I  have  a  pretty  good  idea  who  you're  talking  about.  If  they  think 
it's  hard  to  get  a  good  rating  out  of  me  now,  just  wait  until  I 
rate  them  the  next  time.  They'll  find  out  how  hard  a  brick  wall 
really  is. 

I  guess  I  don't  think  like  you  people  at  all.  I  try  to  be  a 
friend  to  itiy  people.  Some  of  them  are  away  from  home  for  the 
first  time  and  1  don't  like  to  make  it  any  rougher  on  them  than  I 
need  to.  I  try  to  give  ny  people  the  benefit  of  the  doubt  when 
I'm  rating  them.  You'd  be  surprised  what  you  learn  about  your 
people  if  you  try  to  be  their  friend.  For  instance,  there's  a  guy 
on  my  shift  now  who  reminds  me  of  myself  when  I  was  his  age.  He's 
from  a  small  town  and  joined  the  service  to  see  a  little  of  the 
world.  I  can  really  identify  with  him. 

Well,  I  don't  know  about  being  buddy-buddy  with  my  people,  but  I 
do  know  that  right  now  everyone  in  my  unit  is  doing  a  good  job  as 
far  as  I'm  concerned. 

Why  is  that? 

Well,  I'm  up  for  promotion  in  a  couple  of  months.  And  let's  face 
it,  the  better  ray  people  look  on  their  ratings,  the  better  I  look 
as  a  supervisor.  And  the  better  I  look,  the  better  my  chances  are 
for  promoticxi! 
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FRACnCE  RRTIII6  FORMS  BQBSCISES 


Now  you  will  have  the  opportunity  to  practice  using  two  of  the  rating  forms 
that  have  been  discussed,  the  Dimensional  and  the  Air  Force-wide  Rating  Forms. 
The  purpose  of  this  exercise  is  to  help  you  beccme  familiar  and  comfortable 
with  these  rating  forms  and  to  address  any  questions  or  concerns  you  might 
have  regarding  their  use. 


A.  EXORCISE  I  -  DIMBISIGMAL  RATING  FORM 

He  are  going  to  read  a  story  and  use  the  information  in  it  to  complete  a 
sample  Dimensional  Rating  Form  on  SRA  Sknith.  For  now,  you  will  only  be 
concerned  with  Dimensions  1,  2,  4,  and  6  of  the  Dimensional  Rating  Form.  Turn 
the  page  and  let's  read  the  story. 
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DIMBISKIiM.  RMmS  POTM 


Upon  arriving  at  the  shop  one  morning  SRh  Smith  was  asked  to  nake  a 
conprehensive  list  of  parts  the  shop  needed  to  conplete  a  major  modification 
of  a  piece  of  equipment.  She  required  minimal  assistance  and  did  a  thorough 
and  accurate  job  of  researching  part  nixrbers.  All  the  required  forms  were 
coRpleted  with  only  minor  errors. 

Later  that  same  day  Smith  was  selected  to  perform  a  periodic  inspection 
of  an  oxygen  mask.  She  was  called  upon  because  she  had  consistently  completed 
these  periodic  inspections  rapidly  and  accurately  without  supervision.  During 
the  comm  check  she  discovered  that  the  microphone  was  inoperable  and  made  the 
required  repairs. 

After  smith  finished  inspecting  the  oxygen  mask,  an  aircrew  member  came 
in  to  have  a  parachute  fitted.  SRA  Smith  performed  the  fitting  procedure  very 
clunnsily  and  left  several  twists  in  the  mainsling.  In  addition,  she  forgot  to 
show  the  excess  wd:^ing.  Her  supervisor  had  to  correct  her  and  told  her  to  be 
more  careful  in  the  future. 

Before  leaving  for  the  day  SRA  Snnith  was  told  that  the  chem  defense 
training  she  had  scheduled  for  the  following  day  had  been  canceled.  She 
decided  that  rescheduling  could  wait  until  the  next  week.  Smith  was  actually 
pleased  that  the  training  was  postponed  because  she  was  not  as  well  prepared 
as  she  should  have  been  and  had  been  in  the  past. 
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B.  EKStCISE  II  -  AIR  FGRCE-HIQE  RATING  FOM 

Read  the  following  story  and  use  the  infonnaticn  in  it  to  ccnplete  a  sarnple 
Air  Force-wide  Rating  Form  cn  SRA  Jones. 


BORCISE  II 

AIR  PCRCE-WIEE  RATING  FCTM 


SRA  Jones  has  his  5-skill  level  rating  and  has  been  performing  the 
duties  of  a  trainer  since  shortly  after  attaining  this  rating.  His 
supervisors  have  often  remarked  on  his  exceptional  abilities  to  the  extent 
that  they  are  comfortable  in  allowing  him  to  work  virtually  unsv?>ervised.  He 
is  one  of  their  strongest  team  members,  generally  showing  sound  judgment  under 
pressure  and  quickly  becoming  a  role  model  for  some  of  the  less  experienced 
members  of  the  shop. 

On  one  occasion,  a  major  unplanned  exercise  was  announced.  Although 
Jones  was  scheduled  to  go  on  leave  during  this  time,  he  volunteered  to  remain 
to  offer  any  support  and/or  fill  in  if  necessary.  Another  time  he  discovered 
that  a  torque  wrench  had  disappeared  from  the  shop.  Being  a  truthful  person, 
Jones  informed  his  sijpervisor  and  volunteered  to  investigate  the  disappearance 
and  to  stay  until  the  wrench  was  found. 

This  type  of  performance  has  lead  his  Si5>ervisors  to  encourage  him  to 
put  more  effort  into  studying  his  GDC  materials  so  that  he  can  attain  his 
7-skill  level.  Though  it's  apparent  that  he  could  complete  the  course 
rapidly,  he  has  chosen  not  to  push  himself  and  sinply  wants  to  complete  the 
course  requirements  in  the  prescribed  time. 

SRA  Jones  has  been  placed  on  a  6-month  weight  control  program  in  which 
he  must  lose  20  pounds.  He  cladms  that  he  eats  to  release  the  tension  from 
the  job,  and  will  occasionally  go  out  with  others  for  a  few  beers  after  work 
on  a  particularly  tough  day.  He  hates  the  weight  control  program  and  only 
participates  because  he  is  under  orders  to  do  so.  Due  to  this  attitude,  he 
has  failed  to  present  himself  for  periodic  weigh-ins. 
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C.  Exercise  III  -  TIPS  GN  MAKING  JIOGORKIE  RATINSS 


A.  GBIERAL  IMPCIMATION 

nie  most  important  thing  to  ranember  when  making  your  ratings  is  to  focus  your 
attention  only  on  the  person  you  are  rating  and  only  on  the  person's  ability 
to  perform.  Avoid  comparing  the  person  with  co-workers  you've  rated 
previously  or  those  you  will  be  evaluating  later. 

Remeni>er  that  even  though  you  and  the  people  you  rate  are  similar  because  you 
are  all  Aircrew  Life  Support  Specialists,  each  person  has  a  unique  set  of 
strengths  and  weaknesses.  Also,  be  aware  that  poor  or  outstanding  performance 
in  one  area  does  not  dictate  the  quality  of  performance  in  other  areas.  Rate 
the  person  according  to  the  individual's  ability  to  perform  on  the  job  and 
focus  on  behavior  that  you  can  see.  Finally,  do  not  be  afraid  to  use  the 
entire  rai^e  of  the  scale  when  appropriate.  Your  honesty  will  serve  to  ensure 
the  accuracy  of  your  ratings. 
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GESESKL  TUSTfOCTiaHS 


You  are  being  asked  to  take  part  in  a  research  project  aimed  at  determining 
how  useful  different  types  of  rating  forms  are  for  assessing  a  first-term 
airman's  job  performance.  Throughout  the  project,  first-term  Aircrew  Life 
Svqpport  Specialists  will  be  asked  to  complete  those  rating  forms  on  themselves 
and  seme  of  their  co-workers.  In  addition,  NOOs  are  direct  supervisors  of 
the  airmen  will  be  asked  to  provide  evaluations. 

This  information  will  be  used  to  decide  idu.ch  forms  are  the  most  useful.  Ihe 
information  provided  from  the  rating  forms  will  be  ijsed  solely  for  research 
purposes.  It  will  not  be  seen  by  other  airmen  or  anyone  else  connected  with 
yoiir  unit.  In  fact,  we  are  not  concerned  with  the  ratings  an  individual 
receives  or  with  how  an  individual  rates  others.  The  purpose  of  this  project 
is  to  answer  the  question,  "Which  rating  forme  are  most  useful  for  making 
accurate  evaluations?"  These  ratings  will  in  no  way  be  associated  with  you  or 
anyone  involved,  so  please  be  totally  honest  in  yotir  evaluation. 

Information  will  be  collected  from  many  Aircrew  Life  Support  Specialists  at  a 
nurber  of  Air  Force  bases  across  the  country.  Because  future  decisions 
regarding  the  quality  of  the  varioxis  rating  forms  will  be  based  on  information 
provided  by  people  such  as  yourself,  it  is  essential  that  you  take  whatever 
time  is  necessary  to  give  the  most  accurate  ratings  possible. 

This  rating  form  booklet  is  comprised  of  two  major  sections.  The  first 
section  contains  four  (4)  different  rating  forms.  Each  fonn  was  developed 
through  extensive  contact  with  Aircrew  Life  Sv5>port  Specialists.  These  job 
experts  both  developed  and  reviewed  these  forms  and,  therefore,  we  believe  the 
content  of  these  forms  accurately  reflects  the  job  of  an  Aircrew  Life  Sv;q>port 
Specialist.  These  four  rating  forms  will  include;  (1)  a  two-item  global 
rating  form,  (2)  a  more  specific  dimensional  rating  form,  (3)  a  detailed, 
task-specific  form  and  (4)  a  set  of  Air  Force-wide  ratings.  All  ratings  are 
made  on  a  scale  with  five  points  (5-high,  l-low).  A  rating  of  5  indicates 
that  you  always  exceed  the  acceptable  level  of  proficiency  and  a  rating  of  1 
indicates  that  you  never  meet  the  acceptable  level  of  proficiency.  Specific 
instructions  for  completing  each  of  these  rating  forms  are  included  as  part  of 
the  form. 

The  second  major  section  of  this  booklet  contains  a  background  questionnaire 
and  two  additional  rating  forms.  One  rating  form  asks  you  to  rate  the 
usefulness  of  the  rating  forms  you  just  completed  in  the  previous  section. 

The  second  rating  forms  ask  you  to  rate  your  on-the-job  experience  on  certain 
tasks.  As  before,  specific  instructions  for  completing  each  of  these  forms 
are  included  as  part  of  the  form. 
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niSIRDCTICNS 


GLOBAL  RATINS  EOM 


The  purpose  of  this  rating  form  is  to  allow  you  to  evaltiate  an  individual's 
overall  level  of  technical  and  interpersonal  proficiency.  A  five-point  rating 
scale  will  be  provided  on  eaoh  of  the  next  two  pages. 

Technical  proficiency  refers  to  how  skilled  you  are  at  performing  various 
tasks  on  the  lob,  ioaiorinq  interpersonal  factors  (willingness  to  work, 
cooperation  with  others),  or  sitxiational  factors  (lack  of  tools,  parts  or 
eq\Aiixnent). 

Interpersonal  proficiency  refers  to  how  well  you  work  with  various  levels  of 
supervision  and  how  cooperative  you  are  on  a  task  recaiirinq  team  effort. 

Use  the  behavioral  exanples  as  illustrations  of  the  quality  of  work 
performed  at  that  level.  On  the  following  two  pages,  select  the  "Rating" 
corresponding  to  the  overall  level  of  job  proficiency  that  applies  to  yourself 
if  you  are  instructed  to  rate  yourself,  or  to  the  person  you  are  rating  if  you 
are  a  co-worker  or  sv5>ervisor.  Record  your  rating  by  blackening  the 
corresponding  oval  in  the  Global  Rating  Form  section  of  the  answer  sheet. 

The  five  levels  that  will  be  vised  on  this  rating  form  are  listed  below: 


5  Always  exceeds  acceptable  level  of  proficiency 
4  Frequently  exceeds  acceptable  level  of  proficiency 
3  Meets  acceptable  level  of  proficiency 
2  Occasionally  meets  acceptable  level  of  proficiency 
1  Never  meets  acceptable  level  of  proficiency 


PLEASE  RATE  BOTH  ITEMS 


TBCBMICAL  FROPICIENCT 


*^8  refers  to  how  skilled  a  person  is  at  performing  various  tasks  on  the  job, 
ignoring  interpersonal  factors  (willingness  to  work,  cooperation  with  others), 
or  situational  factors  (lack  of  tools,  parts  or  equipment). 


Level  Rating 

Always  exceeds  5 

acceptable  level 
of  proficiency 

Frequently  exceeds  4 

level 

of  proficiency 


Meets  acceptable  3 

level  of 

proficiency 


Occasionally  meets  2 

acceptable  level 
of  proficiency 


Never  meets  1 

acceptable  level 
of  proficiency 


Behavioral  Examples 

Successfully  conpletes  all  tasks 
with  minimal  supervision.  Conpletes 
all  tasks  rapidly,  always  using  proper 
maintenance  procedures. 

Successfully  completes  all  acceptable 
simple  tasks  and  most  complex  tasks 
with  minimal  supervision.  Completes  most 
tasks  rapidly  idiile  consistently  using 
proper  maintenance  procedures. 

Successfully  completes  most  tasks  with 
stpervision.  Occasionally  requires 
excessive  time  to  complete  complex  tasks. 
Usually  uses  proper  maintenance 
procedures. 

Successfully  completes  most  simple  tasks 
with  some  supervision,  but  requires 
constant  supervision  to  successfully 
complete  some  complex  tasks.  Requires 
excessive  time  to  complete  some  complex 
tasks.  Occasionally  vises  improper 
maintenance  procedures. 

Unable  to  successfully  complete  simple 
tasks  without  constant  supervision. 
Requires  excessive  time  to  complete  the 
most  simple  tasks.  Frequently  uses  poor 
maintenance  procedures. 
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UriUUUtSCHAL  FRCFICIENC7 


This  refers  to  how  well  a  person  works  with  various  levels  of  supervision  and 
how  cooperative  he/she  is  on  a  task  requiring  team  effort. 


Level  Rating 

Always  exceeds  5 

acceptable  level 
of  proficiency 


Frequently  exceeds  4 

acceptable  level 
of  proficiency 


Meets  acceptable  3 

level  of 


Occasionally  meets  2 

acceptable  level 
of  proficiency 


Never  meets  1 

acceptable  level 
of  proficiency 


Behavioral  Examples 

Always  works  well  with  all  levels 
of  supervision  and  coworkers; 
works  effectively  in  stressful  situations 
and  on  tasks  requiring  teamwork  or 
cooperation;  always  willing  to  assist 
coworkers  in  completing  a  high  priority 
task  without  being  asked  by  supervisors. 

Frequently  works  well  with  all  levels  of 
supervision  and  co-workers;  works 
effectively  in  stressful  situations  and  on 
tasks  requiring  teamwork  or  cooperation; 
often  willing  to  assist  co-workers  in 
completing  a  high  priority  task  without 
being  asked  by  supervisor. 

Ckx3perates  with  most  supervisors  and 
co-workers;  usually  works  proficiency 
effectively  in  stressful  situations  and  on 
tasks  requiring  teamwork  or  cooperation; 
will  usually  assist  co-workers  in 
completing  high  priority  tasks. 

Cooperates  with  only  a  select  group 
of  supervisors  and  co-workers; 
rarely  works  effectively  in  stressful 
situations  or  on  tasks  requiring  teamwork 
or  cooperation;  assists  co-workers  in 
completing  a  high  priority  task  if  asked 
by  supervisor. 

Is  uncooperative  and  ineffective  when 
working  in  stressful  situations  or  on 
tasks  requiring  teamwork  or  cooperation; 
vnreceptive  to  guidance  by  supervisor  or 
co-worker;  doesn't  care  about  functioning 
well  as  a  member  of  a  umit  or  crew. 
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msmocTioMs 


DIMQISICN\L  IATIN6  FOSi 

The  purpose  of  this  rating  form  is  to  allow  you  to  evaluate  the  level  of 
proficiency  on  groups  of  tasks  or  dimensions.  Remember,  proficiency  refers  to 
how  skilled  an  individual  is  at  performinq  various  tasks  on  the  job,  ignoring 
interpersonal  factors  (willingness  to  work,  cooperating  with  others)  or 
situational  factors  (lack  of  tools,  parts,  or  equipment). 

Listed  below  are  che  dimensions  on  which  you  will  rate  an  airman  (yourself  or 


others) . 

1. 

Administration 

2. 

Helmets  and  Oxygen  Masks 

3. 

Survival  Equipment 

4. 

Aircrew  Clothing 

5. 

Chemical  Defense  Equipment 

6. 

Training  and  Instruction 

On  the  pages  that  follow,  read  the  definition  of  each  dimension  carefully. 
Use  the  behavioral  examples  as  indicators  of  the  quality  of  work  performed  at 
the  various  levels.  Record  your  rating  by  blackening  the  corresponding  oval 
in  the  Dimensional  Rating  Form  sec cion  of  the  answer  sheet. 


The  five  levels  that  will  be  used  on  this  rating  form  are  listed  below: 


5  Always  exceeds  acceptable  level  of  proficiency 
4  Frequently  exceeds  acceptable  level  of  proficiency 
3  Meets  acceptable  level  of  proficiency 
2  Occasionally  meets  acceptable  level  of  proficiency 
1  Never  meets  acceptable  level  of  proficiency 


PLEASE  RATE  ALL  DIMENSIONS 
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Dimensicn  1:  Administration 

Ttie  accurate  pr^aration  and  naintenance  of  facility  operating  fonns, 
pvdalicaticns,  records,  charts,  etc.  Scheduling,  supplying,  and  coordinating 
with  other  agencies.  Exannles;  Direct  issuance  of  equipment;  schedule 
naintenance  or  repair  of  life  support  equipment. 


Level 


Always  exceeds 
acceptable  level 
of  proficiency 


Frequently  exceeds 
acceptable  level 
of  proficiency 


Meets  acceptable 
level  of 
proficiency 


Occasionally  meets 
acceptable  level 
of  proficiency 


Rating  Behavioral  Exarnples 

5  Consistently  performs  all  adnin- 

istrative  tasks  accurately,  com¬ 
pletely,  and  legibly;  rarely  needs  to  be 
directed,  consistently  displays 
initiative;  consistently  conpletes  tasks 
in  a  timely  manner. 

4  Usually  performs  all  administrative 

tasks  accurately,  completely  and 
legibly;  seldom  needs  to  be  directed; 
usually  displays  initiative;  usually 
conpletes  tasks  in  a  timely  manner. 

3  Performs  all  administrative  tasks 

acceptably;  sometimes  needs  to  be 
directed;  sometimes  displays  initiative; 
conpletes  tasks  in  a  timely  manner. 

2  Occasionally  performs  administrative 

tasks  acceptably;  usually  needs  to  be 
directed;  seldom  displays  initiative; 
seldom  conpletes  tasks  in  a  timely  manner. 


Never  meets 
acceptable  level 
of  proficiency 


1  Rarely  performs  administrative  tasks 

acceptably;  consistently  needs  to  be 
directed;  rarely  displays  initiative; 
rarely  conpletes  tasks  in  a  timely  manner. 
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Dimension  2:  Helmets  and  Oxygen  Masks 

The  pouring  and  fabrication  of  helmet  liners  and  the  sizing  and  fitting  of 
helmets  and  oxygen  masks.  Inspecting,  assembling,  cleaning  and 
troubleshooting.  Examples;  Perform  helmet  perio^c  inspections;  adjust 
oxygen  masks. 


Level 


Always  exceeds 
acceptable  level 
of  proficiency 


Frequently  exceeds 
acceptable  level 
of  proficiency 


Meets  acceptable 
level  of 
proficiency 


Occasionally  meets 
acceptable  level 
of  proficiency 


Never  meets 
acceptable  level 
of  proficiency 


Rating  Behavioral  Examples 

5  Always  inspects  and  performs  required 

maintenance  on  the  equipment  acc^tably; 
able  to  troubleshoot  without  supervision; 
consistently  identifies  all  equipment 
malfunctions;  able  to  use  innovative 
techniques  to  improve  on  established 
procedures . 

4  Usually  inspects  aixi  performs  required 

maintenance  on  the  equipment  acceptably; 
able  to  troubleshoot  with  mininun 
supervision;  frequently  identifies 
equipment  malfunctions;  sometimes  uses 
innovative  techniques  to  improve  on 
established  procedures. 

3  Sometimes  inspects  and  performs  required 

maintenance  on  the  equipment  acceptably; 
sometimes  needs  supervision  when  troiible- 
shooting;  sometimes  identifies  equipment 
malfunctions;  seldom  uses  innovative 
techniques  to  inprove  on  established 
procedures . 

2  Occasionally  inspects  and  performs 

required  maintenance  on  the  equipment 
acceptably;  usually  needs  supervision  then 
troubleshooting;  occasionally  identifies 
equipment  malfunctioons;  rarely  uses 
innovative  techniques  to  improve  on 
established  procedures. 

1  Rarely  inspects  and  performs  required 

maintenance  on  the  equipment  acceptably; 
is  unable  to  troubleshoot  without 
supervision;  rarely  identifies  equipment 
malfunctions;  is  unable  to  use  innovative 
techniques  to  improve  on  established 
procedures . 
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Dimension  3:  Survival  Etjuipment 


The  installation  and  removal  of  survival  kit  ccnponents,  the  inspection  and 
repair  of  survival  kits,  parachutes  and  flotation  devices.  Asseirbling  kits, 
storing  survival  equipment,  and  naintaining  foms.  Exaimles:  Tie  in  survival 
kit  conponents;  pack  life  rafts. 


Level  Rating 

Always  exceeds  5 

acceptable  level 
of  proficiency 


Frequently  exceeds  4 

acceptable  level 
of  proficiency 


Meets  acceptable  3 

level  of 

proficiency 


Occasionally  meets  2 

acceptable  level 
of  proficiency 


Never  meets  1 

level 

of  proficiency 


Behavioral  Exanples 

Consistently  inspects  and  performs 
required  maintenance  on  survival 
equipment  acceptably;  able  to  perform  all 
tasks  with  no  supervision;  always  keeps 
forms  up  to  date;  constantly  suggests  new 
techniques  for  installing  ccnponents 
and/or  storing  equipment. 

Usually  inspects  and  performs  required 
maintenance  on  survival  equipment 
acceptably;  able  to  perform  all  tasks  with 
minimun  supervision;  usually  keeps  forms 
vp  to  date;  frequently  suggests  new 
techniques  for  installing  ccnponents 
and/or  storing  equipment. 

Sometimes  performs  required  maintenance 
on  survival  equipment  acceptably; 
sometimes  needs  sipervision  when 
performing  tasks;  sometimes  keeps  forms  up 
to  date;  sometimes  suggests  new  techniques 
for  installing  survival  kit  ccnponents 
and/or  storing  equipment. 

Occasionally  inspects  and  performs 
required  maintenance  on  the  equipment 
acceptably;  usually  needs  sxpervision  when 
performing  tasks;  occasionally  keeps  forms 
ip  to  date;  rarely  suggests  new  techniques 
for  installing  survival  kit  components 
and/or  storing  equipment. 

Rarely  inspects  and  performs  acceptable 
required  maintenance  on  the  survival 
equipment  acceptably;  always  needs 
supervision  when  performing  tasks;  rarely 
keeps  forms  up  to  date;  is  unable  to 
suggest  new  techniques  for  installing 
survival  kit  ccnponents  and/or  storing 
equipment. 
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Dimension  4:  Aircrew  Clothing 


The  sizing,  fitting,  and  inspection  of  aircrew  clothing.  Cleaning  and 
repairing  aircrew  clothing.  Examples:  Perform  anti-G  smt  periodic 
inspections;  coordinate  alterations  on  aircrew  clothing  with  other  facilities. 


Level  Rating 

Always  exceeds  5 

acceptable  level 
of  proficiency 


Frequently  exceeds  4 

acceptable  level 
of  proficiency 


Meets  acceptable  3 

level  of 

proficiency 


Occasionally  meets  2 

acceptable  level 
of  proficiency 


Never  meets  1 

acceptable  level 
of  proficiency 


Behavioral  Exanples 


Consistently  is  able  to  size  and 
fit  aircrew  members  without  the 
need  for  future  fittings;  is  able  to 
inspect  and  repair  aircrew  clothing  with 
no  supervision;  consistently  suggests  new 
techniques  for  modifying  aircrew  clothing 
and  storing  equiEment. 

Usually  is  able  to  size  and  fit  aircrew 
members  without  the  need  for  future 
fittings;  is  able  to  inspect  and  repair 
aircrew  clothing  with  little  supervision; 
frequently  suggests  new  techniques  for 
modifying  aircrew  clothing  and  storing 
equipment. 

Sometimes  is  able  to  size  and  fit  edrcrew 
members  without  the  need  for  future 
fittings;  needs  seme  supervision  while 
inspecting  and  repairing  aircrew  clothing; 
sometimes  suggests  new  techniques  for 
modifying  aircrew  clothing  and  storing 
equipment. 

Rarely  is  able  to  size  and  fit  aircrew 
members  without  the  need  for  future 
fittings;  usually  needs  supervision  while 
inspecting  and  r^airing  aircrew  clothing; 
rarely  suggests  new  techniques  for 
modifying  aircrew  clothing  and  storing 
equipment. 

Is  xmable  to  size  and  fit  aircrew  members 
without  the  need  for  future  fittings; 
always  needs  supervision  vAule  inspecting 
and  repairing  aircrew  clothing;  never 
suggests  new  techniques  for  modifying 
aircrew  clothing  and  storing  equipment. 
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Dimensicn  5:  Chanical  Defense  Equipment 

The  ability  to  size,  fit,  adjxist,  and  modify  chemical  defense  ensembles.  iTie 
operation  of  contamination  control  area  functions.  Examples:  Install  CHD 
filter  assemblies;  cerate  decontamination  chamber  liquid  hazard  areas. 


Level  Rating 

Always  exceeds  5 

acceptable  level 
of  proficiency 


Frequently  exceeds  4 

acceptable  level 
of  proficiency 


Meets  acceptable  3 

level  of 

proficiency 


Occasionally  meets  2 

acceptable  level 
of  proficiency 


Never  meets  1 

acceptable  level 
of  proficiency 


Behavioral  Examples 

Consistently  inspects  and  modifies 
aircrew  chemical  warfare  equipment 
in  the  proper  manner;  always  maintains, 
inventories,  and  stores  equipment 
effectively;  always  operates  and  controls 
appropriate  OCA  functions  efficiently. 

Usually  inspects  and  modifies 
aircrew  chemical  warfare  equipment 
in  the  proper  manner;  frequently 
maintains,  inventories,  and  stores 
equipment  effectively;  frequently  operates 
and  controls  appropriate  CCA  f motions 
efficiently. 

Sometimes  inspects  and  modifies 
aircrew  chemical  warfare  equipment 
in  the  proper  manner;  usually  maintains, 
inventories,  and  stores  equipment 
effectively;  usually  operates  and  controls 
appropriate  OCA  f motions  efficiently. 

Occasionally  inspects  and  modifies 
aircrew  chemical  warfare  equipment 
in  the  proper  manner;  sometimes  maintains 
inventories,  and  stores  equipment 
effectively;  occasionally  operates  and 
controls  appropriate  OCA  fmctions 
efficiently. 

Rarely  inspects  and  modifies 
aircrew  chemical  warfare  equipment 
in  the  proper  manner;  rarely  maintains, 
inventories,  and  stores  equipment 
effectively;  is  unable  to  operate  and 
control  appropriate  OCA  fmctions 
efficiently. 
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DimensiGn  6:  Training  and  Instruction 

The  danncnstration  and  instruction  of  life  support  equipment  functions  and 
uses.  Scheduling,  instructing,  demonstrating,  and  briefing.  Exanpl^; 
Construct  training  aids;  brief  parachute  safety. 


Level  Rating 

Always  exceeds  5 

acceptable  level 
of  proficiency 


Frequently  exceeds  4 

acceptable  level 
of  proficiency 


Meets  acceptable  3 

level  of 

proficiency 


Occasionally  meets  2 

acceptable  level 
of  proficiency 


Never  meets  1 

acceptable  level 
of  proficiency 


Briiavioral  Exanples 

Consistently  perfoms  all  aspects 
of  training  effectively;  always 
instructs  and  briefs  in  a  thoroughly 
professional  nanner;  schedules  and 
conducts  training  with  no  supervision. 

Usually  performs  all  aspects  of 
training  effectively;  usually  instructs 
and  briefs  in  a  professional  manner; 
schedules  and  conducts  training  with 
little  siq>ervision. 

Usually  performs  some  aspects  of 
training  effectively;  sometimes 
instructs  and  briefs  in  a  professional 
manner;  occasionally  needs  some 
supervision  to  schedule  and  conduct 
training. 

Occasionally  performs  some  aspects 
of  training  effectively;  seldom 
instructs  and  briefs  in  a  professional 
manner;  usually  needs  some  supervision  to 
schedule  and  conduct  training. 

Rarely  performs  any  aspects  of  training 
effectively;  never  instructs  or  briefs 
in  a  professional  manner;  always  needs 
supervision  to  schedule  and  conduct 
training. 
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mSIRDCTIOMS 


TASK  lOTIIlS  FGBM 


purpose  of  this  rating  form  is  to  rate  an  individual's  proficdency  at 
performing  a  nurber  of  Aircrew  Life  Support  Specialist  tasks.  Proficiency 
refers  to  how  skilled  a  person  is  at  performing  various  tasks  on  the  job. 
Remember,  we  are  concerned  with  level  of  ability  to  perform  these  tasks, 
excluding  interpersonal  factors  (willingness  to  work,  cooperating  with  others) 
or  situational  factors  (lack  of  tools,  parts,  or  equipnent). 

As  you  rate  each  task,  ask  yourself,  "At  idiat  level  of  proficiency  could  this 
individual  perform  this  particular  task?"  Select  the  "Rating"  corresponding 
to  your  level  of  proficiency  on  each  task  if  you  are  instructed  to  rate 
yourself,  or  to  the  person  you  are  rating  if  you  are  a  co-worker  or 
svq>ervisor.  Record  your  rating  by  blackening  the  corresponding  oval  in  the 
Task  Rating  Form  section  of  the  answer  sheet.  Please  provide  a 
rating  for  each  task  on  the  following  pages,  even  if  the  task  is  not  performed 
frequently. 


The  five  levels  that  will  be  used  on  this  rating  form  are  listed  below: 


5  Always  exceeds  acceptable  level  of  proficiency 
4  Frequently  exceeds  acceptable  level  of  proficiency 
3  Meets  acceptable  level  of  proficiency 
2  Occasionally  meets  acceptable  level  of  proficiency 
I  Never  meets  acceptable  level  of  proficiency 


PLEASE  RATE  ALL  TASKS 
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5  Always  exceeds  acceptable  level  o£  proficiency 
4  Frequently  exceeds  acceptable  level  of  proficiency 
3  Meets  acc^table  level  of  proficiency 
2  Occasionally  meets  acceptable  level  of  proficiency 
1  Never  meets  acceptable  level  of  proficiency 


1.  Schedule  maintenance  or  repair  of  life  support  equipment. 

2.  Make  entries  on  AFTO  Form  152  (chemical  ensemble  inspection  record). 

3.  Make  entries  on  AFTO  Form  338  (survival  kit  record). 

4.  Perform  aircraft  life  support  equipm^t  acceptance  inspections. 

5.  Bxiild  up  helmet  from  shell. 

6.  Fit  a  helmet  using  a  custom  liner. 

7.  Pour  and  fabricate  helmet  liner  mold. 

8.  Replace  the  nape  strap  and  pad. 

9.  Remove  or  replace  headsets  in  helmets. 

10.  Perform  initial  assembly  of  oxygen  masks. 

11.  Size  and  fit  oxygen  masks. 

12.  Remove  and  install  CWD  filter  assemblies. 

13.  Operate  decontamination  chamber  vapor  hazard  areas. 

14.  Fit  or  adjust  parachute  harnesses. 

15.  Perform  survival  kit  component  periodic  inspections. 

16.  Repack  soft  pack  survival  packs. 

17.  Make  entries  on  AFTO  Form  406  (mesh  net  survival  vest  inspection 
record) . 

18.  Perform  anti-G  suit  periodic  inspections. 

19.  Perform  helmet  periodic  inspections. 

20.  Perform  oxygen  mask  periodic  inspections. 
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>  Always  exceeds  acceptable  level  of  proficiency 
1  Frequently  exceeds  acceptable  level  of  proficiency 
1  Meets  acceptable  level  of  proficiency 
I  Occasionally  meets  acceptable  level  of  proficiency 
L  Never  meets  acceptable  level  of  proficiency 


21.  Inspect  the  inflation  assembly. 

22.  Remove  and  replace  seat  kits. 

23.  Make  entries  on  AETO  Form  392  (parachute  repack,  inspection,  and 
component  record). 

24.  Make  entries  on  DD  Form  1574  (serviceable  tag-rnaterial ) . 

25.  Perform  oxygen  mask  connector  periodic  inspections. 

26.  Inspect  CND  equipment. 

27.  Operate  decontamination  chamber  liquid  hazard  areas. 


no 


msiRDcrioHs 


AIR  FOtCE-WITE  RMmiS  FGRt 


The  purpose  of  this  rating  form  is  to  allow  you  to  evaluate  an  individual's 
performance  on  factors  iir^rtant  to  all  airmen  regardless  of  Air  Force 
specialty. 


Listed  below  are  the  performance  factors  you  will  consider  in  your  ratings: 


1.  Technical  Riowledge/Skill 

2.  Initiative/Effort 

3.  Khowledge  of  and  Adherence  to  Regulations/Orders 

4.  Integrity 

5.  Leadership 

6.  Military  Appearance 

7.  Self  Developnnent 

8.  Self  Control 


Qrx  the  pages  that  follow,  read  the  definition  of  each  performance  factor 
carefully.  Use  the  behavioral  examples  as  indicators  of  behavior  typically 
displayed  at  the  various  levels.  Select  the  "Rating"  that  corresponds  to  the 
level  best  describing  your  performance  in  each  area  if  you  are  instructed  to 
rate  yourself,  or  to  the  other  person's  level  of  performance  if  you  are  a 
co-worker  or  supervisor.  Record  your  rating  by  blackening  the  corresponding 
oval  in  the  Air  Force-wide  Rating  Form  section  of  the  answer  sheet. 


The  five  levels  that  will  be  used  on  this  rating  form  are  listed  below: 

5  Always  exceeds  acceptable  level  of  performance 
4  Frequently  exceeds  acceptable  level  of  performance 
3  Meets  acceptable  level  of  performance 
2  Occasionally  meets  acceptable  level  of  performance 
1  Never  meets  acceptable  level  of  performance 


PLEASE  RATE  ALL  PERFORMANCE  FACTOR 
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Perfomance  Factor  1:  Technical  Knowledge/ Ski  11 


Displaying  job  knowledge  and  skill. 


Level  Rating 

Always  exceeds  5 

acceptable  level 
of  perfomance 


Frequently  exceeds  4 

acceptable  level 
of  perfonrance 


Meets  acceptable  3 

level  of 

performance 


Occasionally  meets  2 

acceptable  level 
of  perfonrance 


Never  meets  1 

acceptable  level 
of  perfonrance 


Behavioral  Exatrples 


Displays  exceptional  knowledge/ ski 11  to 
consistently  conplete  assignments  and 
tasks  properly;  requires  little  or  no 
supervision;  conpletes  tasks  in  minitrurr 
time. 

Displays  considerable  knowledge  and 
skill  to  complete  assignments  and 
tasks  properly;  performs  effectively  with 
little  supervision;  completes  tasks  more 
quickly  than  the  average  first-term 
airman. 

Displays  good  knowledge/ ski 11  in  most 
aspects  of  the  job;  able  to  properly 
complete  the  majority  of  tasks;  requires 
supervision  only  on  difficult  tasks  and 
assignments;  conpletes  work  in  the  satrre 
anrount  of  tirtre  as  other  first-term  airmen. 

Occasionally  displays  adequate  knowledge 
about  how  to  complete  tasks  and  assign¬ 
ments;  quality  of  work  is  inconsistent; 
requires  direct  supervision  on  most  tasks 
to  ensure  quality  and  accuracy;  usually 
completes  tasks  within  required  time. 

Does  not  display  knowledge  and  skill 
necessary  to  properly  complete  tasks  and 
assignments;  unable  to  perform  without 
direct  supervision;  often  fails  to 
complete  assignments;  performs  more  slowly 
than  other  first-term  airmen. 
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Perfornence  Factor  2:  Iiutiative/Effort 


lowing  initiative  and  extra  eifort  on  job/mission/ assignment . 


Level 

Rating 

Behavioral  Exanoles 

Always  exceeds 
acceptable  level 
of  perfomence 

5 

Always  volunteers  vdien  opportunities 
arise;  dannonstrates  initiative 
pronptly  and  effectively;  enthusiastically 
works  extra  hours  to  ensure  completion  of 
project;  works  to  conpletion  when 
situation  becomes  difficult. 

Frequently  exceeds 
acceptable  level 
of  performance 

4 

Frequently  volunteers  and  demonstrates 
initiative  when  opportunities  arise; 
usually  performs  with  enthusiasm  despite 
difficulty;  willing  to  work  extra  hours  to 
complete  assignment. 

Meets  acceptable 
level  of 
performance 

3 

Volunteers  for  some  assignments;  willing 
to  put  in  extra  effort  and  time  on 
priority  tasks;  does  not  give  up  easily 
vrtien  faced  with  obstacles  or  difficulty. 

Occasionally  meets 
level 

of  performance 

2 

Seldom  volunteers  or  displays  acceptable 
initiative;  may  avoid  difficult  assign¬ 
ments;  has  a  tendency  to  stop  working  when 
tired  or  bored;  will  work  extra  hours  only 
when  required. 

Never  meets 
acceptable  level 
of  performance 

1 

Displays  no  initiative  and  never 
volunteers  for  assignments;  reluctant 
to  work  extra  hours;  may  become  hostile 
when  asked  to  put  forth  extra  effort; 
performs  ineffectively  due  to  lack  of 
effort;  gives  up  easily  idien  faced  with  a 
difficult  task. 
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Performance  Factor  3: 

Riowledge  of  and  Adherence  to  Regulations/Orders 

Displaying  knoMledge  of  and  adherence  to  Air  Force  (AF}/unit  rules, 
.'gulations  and  orders  and  displaying  respect  for  authority. 


Level  Rating 

Always  exceeds  5 

acceptable  level 
of  perfomance 


Frequently  exceeds  4 

acceptable  level 
of  performance 


Meets  acceptable  3 

level  of 

perfonrance 


Occasicnally  meets  2 

acceptable  level 
of  performance 


Never  meets  1 

acceptable  level 
of  performance 


Behavioral  Exanples 

Demonstrates  an  exceptional  knowledge 
and  vnderstanding  of  AF/unit  rules  and 
regulations.  Follows  spirit  as  well  as 
the  letter  of  rules  and  regulations;  cjbeys 
orders  quickly;  always  reports  prcnptly 
for  duty,  fornetions,  appointments,  etc.; 
remains  alert  while  on  duty  even  vdien  it 
is  inconvenient  to  do  so. 

Demonstrates  an  excellent  knowledge 
and  understanding  of  AF/unit  rules  and 
regulations;  always  obeys  orders  without 
fail;  can  be  counted  on  to  be  at  appointed 
area  on  time;  displays  appropriate  respect 
for  authority. 

Follows  AF/unit  rules  and  regulations 
almost  without  fail;  is  knowledgeable  of 
those  rules  and  regulations  that  concern 
safety  or  security;  rarely  late  for  duty 
or  formation;  never  leaves  assigned  duty 
section,  always  obeys  orders. 

Occasionally  may  fail  to  follow  AF 
rules  or  regulations;  occasionally 
late  for  duty  formations;  usually  obeys 
orders  but  may  question  them. 

Ignores  or  fails  to  follow  AF/unit 
rules,  regulations,  or  orders;  often 
displays  lack  of  respect  toward  superiors; 
may  leave  assigned  work  area. 
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Performance  Factor  4:  Integrity 
Displaying  honesty  and  integrity  in  job-related  matters. 


Level 


Always  exceeds 
acceptable  level 
of  performance 


Frequently  exceeds 
acceptable  level 
of  performance 


Meets  acceptable 
level  of 
performance 


Occasionally  meets 
acceptable  level 
of  performance 


Never  meets 
acceptable  level 
of  performance 


Rating  Behavioral  Examples 

5  Can  be  trusted  to  be  honest  and  truthful 

in  all  matters  even  when  own  self 
interests  might  be  jeopardized;  takes 
extra  steps  to  protect  the  security  of 
military  equipnnent/supplies;  voluntarily 
reports  thefts,  misconduct,  and  any  other 
violations  of  military  order  and 
discipline. 

4  Admits  job-related  mistakes  and  provides 

information  necessary  for  administrative 
decisions;  voluntarily  reports  thefts, 
misconduct  and  other  incidents  of  military 
violation;  never  misuses  military 
equipment/suppl  ies . 

3  Admits  job-related  mistakes  and  provides 

infonrrtion  necessary  for  adidnistrative 
decif  nns;  reports  obvious  misconduct,  and 
military  violations;  unlikely  to  misuse 
military  equipment/supplies;  returns  found 
property  to  rightful  owner. 

2  Seldom  admits  job- related  mistakes 

and  may  make  excuses  to  avoid 
responsibility  for  such  mistakes;  will 
provide  information  regarding  thefts, 
misconduct,  and  other  military  violations 
if  asked  by  supervisor  but  will  not 
volunteer  such  information;  returns  found 
property  to  rightful  owner. 

1  Denies  responsibility  for  job-related 

mistakes  and  puts  blame  on  someone  else; 
assists  in  covering  up  or  is  otherwise 
directly  involved  in  incidents  of  theft, 
misconduct,  and  other  military  violations; 
dishonest  and  deceitful  in  dealings  with 
supervisor  and  peers;  falsifies  military 
forms,  vouchers,  or  records  to  further 
personal  gains. 
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Perfonrance  Factor  5:  Leadership 


Performing  in  a  leader  role,  as  required,  and  providing  si^port  for  fellow 
unit  members. 


Level  luting 

Always  exceeds  5 

acceptable  level 
of  perfornance 


Frequently  exceeds  4 

acceptable  level 
of  performance 


Meets  acceptable  3 

level  of 

performance 


Occasionally  meets  2 

acceptable  level 
of  performance 


Never  meets  1 

acceptable  level 
of  performance 


Behavioral  Examples 

Performs  very  effectively  when  placed 
in  leadership  position;  takes  charge 
when  necessary  and  fills  in  effectively 
for  stqpervisor;  is  sought  out  as  resource 
person  and  serves  as  role  model;  always 
lodes  out  for  and  svq>ports  fellow  unit 
members  whoi  they  are  in  trouble,  need 
encoturagement ,  performing  poorly,  etc. 

Performs  effectively  in  most  leadership 
situations;  usually  looks  out  for  and 
supports  fellow  unit  members  when  they  are 
in  trouble,  need  encouragement,  performing 
poorly,  etc. 

Performs  effectively  in  structured 
leadership  situations  and  less  well 
in  difficult  situations  requiring  hard 
judgments,  and  quick  decisions;  is 
svq>portive  of  fellow  unit  members  at 
important  times. 

Seldom  effective  in  leadership  positions; 
will  not  go  out  of  way  to  provide  support, 
encouragement,  etc.,  to  fellow  unit 
members;  reluctant  to  help  others  complete 
their  assignments. 

Unable  to  perform  in  leadership  positions; 
unable  to  step  in  and  take  charge  even 
fdien  necessary;  unwilling  to  provide 
support,  encouragement,  etc.,  to  fellow 
unit  members;  shows  impatience  and 
insensitivity  to  other  unit  personnel. 
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Perfornance  Factor  6:  Military  Appearance 

Maintaining  proper  military  appearance  and  meeting  military  standards  for 
physical  fitness. 


Level  Rating 

Always  exceeds  5 

acceptable  level 
of  performance 


Frequently  exceeds  4 

acceptable  level 
of  performance 


Meets  acceptable  3 

level  of 

performance 


Occasionally  meets  2 

acceptable  level 
of  performance 


Never  meets  1 

acceptable  level 
of  performance 


Behavioral  Examples 

Always  properly  and  neatly  dressed, 
even  beyond  the  requirements  of  military 
standards;  consistently  presents  an 
impressive  appearance;  maintaii^  excellent 
persoanal  hygiene  and  cleanliness  even 
imder  dirty  or  difficult  conditions;  is  in 
excellent  physical  condition  aiul 
substantially  exceeds  Air  Force  standards 
for  physical  stamina  and  strength. 

Maintadns  a  crisp,  neat  military 
appearance;  maintains  personal  hygiene 
and  cleanliness;  is  in  excellent  physical 
condition  and  often  exceeds  Air  Force 
standards  for  physical  stamina  and 
str«vgth. 

Dresses  neatly  and  properly  during 
duty  and  at  inspections;  pays  sufficient 
attention  to  personal  cleanliness  and 
hygiene  to  meet  military  standards;  is  in 
good  physical  condition  and  meets  Air 
Force  standards  for  weight,  physical 
stamina,  and  strength. 

Usually  dresses  properly  for  inspections 
but  often  fails  to  present  a  proper 
military  appearance  on  a  daily  basis;  is 
in  fair  physical  condition  and  may  fail 
Air  Force  standards  for  weight,  physical 
stamina,  or  strength. 

Consistently  dresses  sloppily  and/or 
improperly  for  duty  and  at  inspections; 
fails  to  attend  to  personal  cleanliness 
and  hygiene;  is  in  poor  physical  condition 
and  fails  Air  Force  standards  for  weight, 
physical  stamina,  and  strength. 
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Performance  Factor  7:  Self  Develppnnent 


Develq^ing  job-related  skills. 


Level 


Always  exceeds 
acceptable  level 
of  performance 


Frequently  exceeds 
acceptable  level 
of  performance 


Meets  acceptable 
level  of 
performance 


Occasionally  meets 
acceptable  level 
of  performance 


Never  meets 
acceptable  level 
of  performance 


Rating  Behavioral  Exaitples 

5  Devotes  a  substantial  amount  of  off-duty 

time  to  stxidying  and  practicing  to 
become  as  proficient  as  possible  in 
important  job-related  skills; 
enthusiastically  takes  on  additional  job 
duties  and  responsibilities  to  prepare  for 
promotion;  actively  seeks  out 
opportunities  for  self -improvement; 
completes  Career  Development  Course  (CDC) 
requirements  in  less  than  prescribed  time, 
and  consistently  obtains  above-average 
scores  in  CDC  volunes. 

4  Studies  and  practices  during  off-duty 

hours  to  improve  job-related  skills; 
takes  advantage  of  most  opportunities 
presented  to  take  on  additional 
responsibility  that  would  help  prepare  for 
pro-motion;  completes  CDC  requirements  in 
less  than  required  time. 

3  Is  aware  of  personal  weaknesses  in 

job-related  skills  and  participates 
in  training  programs  to  improve  these 
areas;  sometimes  reluctant  to  take  on 
extra  responsibility  that  would  help 
prepare  for  promtion;  completes  CDC 
requirements  within  prescribed  time. 

2  Participates  half-heartedly'without 

seriously  applied  effort  in  training 
programs;  studies  manuals  or  practices  to 
improve  job  skills  only  rAmx  ordered  to  do 
so;  avoids  additional  responsibility  that 
mdqht  help  prepare  for  promotion;  may 
require  re- testing  to  fulfill  CDC 
requirements. 

1  Does  not  participate  in  training  programs; 

makes  no  effort  to  improve  below  standard 
job  skills;  fails  CDC  requirements  due  to 
lack  of  interest,  effort,  or  attention. 


118 


Perfonnance  Factor  8:  Self  Control 


Controlling  personal  behavior. 


Level 


Always  exceeds 
acceptable  level 
of  perfomance 


Frequently  exceeds 
acceptable  level 
of  performance 


Meets  acceptable 
level  of 
performance 


Occasionally  meets 
acceptable  level 
of  performance 


Never  meets 
acceptable  level 
of  performance 


Rating  Behavioral  Examples 

5  Meets  all  financial  (dsligations; 

consistently  displays  exceptional 
emotional  maturity;  does  not  allow 
personal  matters  to  interfere  with 
professional  duties. 

4  Meets  all  financial  obligations; 

usually  displays  appropriate  emotional 
bdiavior  and  control;  does  not  allow 
personal  problems  to  influence  job 
performance. 

3  Meets  most  financial  and  legal 

obligations;  related  problems  are 
minor  and  infrequent  and  rarely  interfere 
with  job  performance;  usually  displays 
emotional  maturity. 

2  Frequently  has  financial  problems 

due  to  lack  of  self  discipline; 
attenpts  to  control  temper  and  emotional 
behavior  but  frequently  fails  to  do  so; 
allows  personal  matters  to  affect  job 
performance. 

1  Does  not  attempt  to  control  temper 

or  otherwise  displays  inappropriate 
b^iavior;  consistently  requires  time  off 
from  duty  to  attend  to  financial ,  legal , 
or  other  personal  problems. 
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GBIERAL  BACRGKODND 


YOUR 

NAME  _ 

Last  First 


MI 


SEN 


The  following  questions  pertain  to  your  work  experience,  your  work  unit  and 
your  feelings  about  your  job.  This  infornaticn  will  be  used  for  research 
purposes  only. 


1.  Months  in  present  unit:  _ 

Record  your  responses  to  the  following  questions  by  blackening  the 
corresponding  oval  in  the  General  Background  section  of  the  answer  sheet. 
Leave  the  first  question  on  the  answer  sheet  blank.  Begin  recording  your 
responses  starting  with  question  2. 

2.  Major  conmand  (MAJOGM)  currently  assigned  to: 

1  SAC 

2  MAC 

3  TAC 

4  Other 

3.  Are  you  a  cross  trainee? 

1  Yes 

2  No 

4.  Section  currently  assigned  to: 

1  Flight line 

2  Helmets  and  Oxyv^  Masks 

3  Survival  Kits 

4  CND 

5  Other 

5.  Are  you  qualified  in  the  Flightline  section? 

1  Yes 

2  No 

6.  Are  you  qualified  in  the  Helmet  and  Oxygen  Mask  section? 

1  Yes 

2  No 
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7.  Are  you  qualified  in  the  Survival  Kit  section? 

1  Yes 

2  No 

8.  Are  you  qualified  in  the  CWD  section? 

1  Yes 

2  No 

9.  In  general,  how  is  morale  in  your  unit? 

1  Extremely  high 

2  Fairly  high 

3  Average 

4  Fairly  low 

5  Extremely  low 


For  the  following  questions,  use  the  scale  provided  below  to  respond  to  eacdi 
statement.  Record  your  responses  by  blackening  the  corresponding  oval  in  the 
General  Background  section  of  the  answer  sheet. 


1  =  Strongly  Disagree 

2  =  Disagree 

3  -  Neither  Agree  nor  Disagree 

4  =  Agree 

5  =  Strongly  Agree 


10.  The  technical  manuals  and  other  written  materials  that  I  use  in  my  job 
are  clear  and  understandable. 

11.  The  technical  manuals  and  other  written  materials  that  I  use  in  my  job 
are  available  when  I  need  them. 

12.  The  tools  and  equipnnent  that  I  use  in  my  job  are  available  \Aien  1  need 
them. 

13.  I  ^Bn  able  to  use  my  skills  and  talents  in  my  job. 

14.  I  get  a  sense  of  accomplishnent  from  my  job. 

15.  I  feel  that  my  supervisor  is  concerned  about  my  well-being. 

16.  I  feel  that  my  supervisor  gives  me  the  support  that  I  need  to  do  my  job. 

17.  I  feel  that  my  job  is  interesting. 

18.  I  get  a  sense  of  pride  from  being  in  the  Air  Force. 
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19.  I  feel  that  nv  job  is  iinportant  to  the  overall  mission  of  the  Air  Force. 

20.  I  am  satisfied  with  my  job. 

21.  I  feel  a  strong  sense  of  responsibility  to  my  unit. 

22.  I  perform  my  duties  to  the  best  of  my  abilities. 
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RMrniS  FOM  gOESriGNOURE 


In  the  following  questions  we  are  interested  in  your  beliefs  about  the 
usefulness  of  the  rating  foms  you  just  ccnpleted.  Please  respond  to  each 
statament  using  the  scale  provided  below.  Record  your  responses  by  blackening 
the  corresponding  oval  in  the  Rating  Form  Questionnaire  section  of  the  answer 
sheet. 

Not  at  To  a  snail  To  a  noderate  To  a  great  To  a  very 
All  Extent  Extent  Extent  Great  Extent 

/ _ ! _ / _ / _ / 

1  2  3  4  5 

1.  How  motivated  were  you  to  conplete  the  rating  forms? 

2.  Did  you  find  the  performance  ratixtg  process  interesting? 

3.  Did  you  care  how  accurate  your  ratings  were? 

4.  Did  you  feel  it  was  important  to  make  accurate  ratings? 

5.  Did  you  make  an  "extra  effort"  to  carefully  pay  attention  to  all  of  the 
instructions  and  examples  in  order  to  make  accurate  ratings? 

6.  Are  you  satisfied  that  you  made  the  most  accurate  ratings  you  could? 

7.  Based  on  your  experience  in  this  project,  how  inportant  is  it  to  you  to 
make  any  performance  ratings  you  do  as  accurate  as  you  can? 

8.  Do  you  believe  that  the  true  pxirpose  of  the  ratings  was  the  one 
explained  to  you  during  the  rater  orientation? 

9.  Do  you  feel  other  persons  involved  really  tried  to  follow  the  rules  in 
completing  their  ratings? 

10.  Do  you  feel  other  persons  involved  really  cared  about  making  accurate 
ratings? 

11.  Do  you  believe  that  the  ratings  collected  will  be  used  for  research 
purposes  only? 

12.  Do  you  think  other  persons  involved  gave  higher  ratings  than  persons 
deserved? 

13.  Will  your  supervisor  have  access  to  any  information  about  you  collected 
from  the  rating  forms? 

14.  Do  you  feel  other  persons  were  comfortable  giving  low  ratings  to 
themselves  or  others? 


Not  at  To  a  small  To  a  moderate  To  a  great  To  a  very 
All  Extent  Extent  Extent  Great  Extent 

/ _ t _ ( _ / _ / 

1  2  3  4  5 


Do  the  rating  forms  evaluate  your  job  proficiency  fairly? 

15.  Global  Rating  Form 

16.  Dimensicnal  Rating  Form 

17.  Task  Rating  Form 

18.  Air  Force-Wide  Rating  Form 

Are  the  rating  forms  easy  to  use  and  understandable  as  a  means  of  determining 
job  proficiency? 

19.  Global  Rating  Form 

20.  Dimensional  Rating  Form 

21.  Task  Rating  Form 

22.  Air  Force-Wide  Rating  Form 

Would  you  be  able  to  tell  the  difference  between  good  and  poor  performers  by 
looking  at  the  ratings  they  were  given? 

23.  Global  Rating  Form 

24.  Dimensional  Rating  Form 

25.  Task  Rating  Form 

26.  Air  Force-Wide  Rating  Form 

If  someone  were  to  lode  at  the  ratings  on  the  form,  would  they  be  able  to  get 
a  true  picture  of  the  performance  level  of  the  person  being  rated? 

27.  Gld>al  Rating  Form 

28.  Dimensional  Rating  Form 

29.  Task  Rating  Form 

30.  Air  Force-Wide  Rating  Form 
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Not  at  To  a  small  To  a  moderate  To  a  great  To  a  very 
All  Extent  Extent  Extent  Great  Extent 

/ _ ! _ / _ / _ ! 

1  2  3  4  5 

Overall,  are  the  rating  forms  acceptable  to  you  as  a  way  to  determine  jdo 
proficiency? 

31.  Global  Rating  Form 

32.  Dimensional  Rating  Form 

33.  Task  Rating  Form 

34.  Air  Force-Wide  Rating  Form 

Overal 1 ,  did  you  feel  confident  about  the  ratings  you  nade?  , 

35.  Global  Rating  Form 

36.  Dimensional  Rating  Form 

37.  Task  Rating  Form 

38.  Air  Force-Wide  Rating  Form 


STOP 


TOE  FOLLOWING  SECTION  CONTAINS 
ONLY  TOREE  QUESTIONS  WHICH  ASK 
YOU  TO  RANK  ORDER  TOE  RATING 
FORMS.  READ  TOE  INSTRUCTIONS 
CAREFULLY  BEPCX^  ANSWERING! ! ! 
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In  the  following  questions,  we  are  interested  in  your  beliefs  about  the  rating 
forms  in  cornparison  to  one  another.  For  each  question,  please  rank-order  the 
four  rating  forms  using  a  "I"  for  the  best,  a  "2''  for  next  best,  and  so  on. 

For  exanple,  if  you  feel  that  the  Air  Force-Wide  rating  form  provides  the  most 
accurate  ratings  of  a  person's  performance  you  would  record  your  rating  by 
blackening  the  oval  labeled  "1"  for  the  item  corresponding  to  "Air  Force-Wide 
Rating  Form"  in  the  Rating  Form  Questionnaire  section  of  the  answer  sheet. 
Similarly,  if  you  feel  that  the  Task  Rating  Form  is  next  to  the  worst  at 
providing  accurate  ratings,  you  would  blacken  the  oval  labeled  "3"  for  the 
item  corresponding  to  "Task  Rating  Forms." 

Please  be  sure  to  rank  each  type  rating  form  for  each  question.  Also,  use 
each  ranking  nunnber  (1,  2,  3,  4}  only  once  for  each  question. 


Are  they  easy  to  use  and  ixnderstandable? 


.  39. 

Global  Rating  Form 

40. 

Dimension  Rating  Form 

41. 

Task  Rating  Form 

42. 

Air  Force-Wide  Rating  Form 

Can  you  tell 

the  difference  between  good  and  poor  performers? 

43, 

Global  Rating  Form 

44. 

Dimension  Rating  Form 

45. 

Task  Rating  Form 

46. 

Air  Force-Wide  Rating  Form 

Can  you  get 

a  true  picture  of  someone's  performance  level? 

47.  Global  Rating  Form 

48.  Dimension  Rating  Form 

49.  Task  Rating  Form 

50.  Air  Force-Wide  Rating  Form 
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STOP 


OCMPLETE  IHE  FOLLOWING  SECTIOI  ONLY  IF  YOU  ARE  RATING  YOURSELF. 
RECORD  YOUR  RATINGS  IN  'HIE  TASK  EXPE31IEIIGE  SECTION  OF  THE  ANSWER 
SHEET. 


IF  YOU  ARE  RATING  A  OO-WORKER  OR  IF  YOU  ARE  A  SUPERVISOR,  STOP  AT 
THIS  POINT  AND  RETORN  THE  BOC»LBr  TO  THE  AEMINISTHATOR. 


127 


TASK  EXPHUBICE  gOESTIOKRAIRE 


Read  each  task  statement  and  think 
about  the  amount  of  relevant  on- the- job 
experience  you've  had  on  that  task, 
excludii^  technical  school  training. 
Using  the  scale  provided,  select  the 
nunnber  that  corresponds  to  your  level 
of  experience.  Record  your  rating  by 
blackening  the  corresponding  oval  in 
the  Task  Experience  section  of  the 
answer  sheet. 


1.  No  or  almost  none 

2.  h  small  amount 

3.  A  moderate  amount 

4.  A  great  amount 

5.  A  very  great  amount 


1.  Schedule  maintenance  or  repair  of  life  support  equiptnent. 

2.  Hake  entries  on  AFTO  Form  152  (chemical  ensenhle  inspection  record). 

3.  Make  entries  on  AETO  Form  338  (survival  kit  record). 

4.  Perform  aircraft  life  support  equipment  acceptance  inspections. 

5.  Build  up  helmet  from  shell. 

6.  Fit  a  helmet  using  a  custom  liner. 

7.  Pour  and  fabricate  helmet  liner  mold. 

8.  Replace *the  nape  strap  and  pad. 

9.  Remove  or  replace  headsets  in  helmets. 

10.  Perform  initial  assenhly  of  oxygen  masks. 

11.  Size  and  fit  oxygen  masks. 

12.  Remove  and  install  CHD  filter  assemblies. 

13.  Operate  decontamination  chamber  vapor  hazard  areas. 

14.  Pit  or  adjust  parachute  harnesses. 

15.  Perform  sxirvival  kit  component  periodic  inspections. 

16.  Repack  soft  pack  survival  packs. 

17.  Make  entries  on  AFTO  Form  406  (mesh  net  survival  vest  inspection 
record) . 
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No  or  almost  none 
A  srrall  amount 
A  moderate  amount 
A  great  amount 
A  very  great  amount 

nvmber  that  corresponds  to  your  level 
of  experience.  Record  your  rating  by 
blackening  the  corresponding  oval  in 
the  Task  Experience  section  of  the 
answer  sheet. 


Read  each  task  statement  and  think  1. 
about  the  amount  of  relevant  on-the-job  2. 
experience  you've  had  on  that  task,  3. 
excluding  technical  school  training.  4. 
Using  the  scale  provided,  select  the  5. 


18.  Perform  anti-G  suit  periodic  inspections. 

19.  Perform  helmet  periodic  inspections. 

20.  Perform  oxygen  nask  periodic  inspections. 

21.  Inspect  the  inflation  assembly. 

22.  Remove  and  replace  seat  kits. 

23.  Make  entries  on  AFPO  Form  392  (parachute  repack,  inspection,  and 
conponent  record). 

24.  Make  entries  on  M)  Form  1574  (serviceable  tag-ireiterial ) . 

25.  Perform  oxygen  mask  connector  periodic  inspections. 

26.  Inspect  CUD  equipment. 

27.  Operate  decontamination  chamber  liquid  hazard  areas. 
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JgPHiDIX  F:  JGB  KNCNUSDGE  TEST  MKTERIALS 
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MANUAL  FOR  AEMINISTRATIGN 
OF  THE  AIRCREM  LIFE  SUPPORT  SPECIALTY 
30B  KNQHLESGE  TESTS 


1.  Introduction 


TTie  Job  Knowledge  Tests  (JKTs)  are  an  inportant  part  of  the  Job 

Perfornence  Measurement  project.  JRTs  are  being  considered  as  possible  _ 

substitute  tests  for  th<:  labor  intensive  Walk-Through  Performance  Test  (WTPT) . 
It  is  very  inportant  that  the  JKT  results  are  accurate  so  that  we  can 
effectively  conpare  those  results  to  the  WTPT  results. 

2.  Testing  Conditions  and  Standards 

In  order  to  exercise  good  test  administration  practices,  it  i?  inportant 
to  have  adequate  testing  facilities.  Sound  judgment  must  be  used  when 
accepting  testing  facilities. 

It  will  often  be  difficult  to  achieve  ideal  testing  conditions  in  field 
locations.  Consideration  of  the  following  items  will  help  provide  adequate 
conditions: 


a.  The  testing  room  must  be  reasonably  quiet.  Tests  should  not  be 
given  in  a  location  idiere  ordinary  business  is  being  conducted. 

b.  Lighting,  ventilation,  and  temperature  are  to  be  as  acceptable  as 
possible.  These  things  are  difficult  to  control  in  some 
locations,  but  the  conditions  should  not  be  so  extreme  that 
concentration  is  interrupted. 

c.  Each  examinee  should  be  allotted  a  working  space  which  is  flat, 
smooth,  and  large  enough  to  accomnodate  an  open  test  booklet  and 
an  answer  sheet. 

3.  Examinee  and  Test  Proctor  Considerations 


It  is  very  inportant  that  examinees  feel  the  test  is  worthidiile  and  that 
their  best  performance  should  be  displayed. 

Examinees  should  not  be  distressed  by  substantial  physical  discomfort. 

To  help  insvure  that  the  examinee  is  in  good  physical  state,  no  testing  session 
should  be  scheduled  after  strenuous  periods  of  work  or  near  the  conclusion  of 
a  work  d?y. 

The  test  proctor  must  be  constantly  alert  for  signs  of  cheating  such  as 
use  of  crib  sheets  or  unauthorized  testing  aids,  including  calculators. 

The  test  proctor  should  be  thoroughly  familiar  with  the  purpose  of  the 
test,  the  directions  to  be  read,  and  how  to  deal  with  problems  that  may  arise. 
The  proctor  should  rehearse  the  directions  so  that  they  can  be  read  clearly, 
without  sturbling  over  words  or  sentences.  Familiarity  with  test  content  is 
also  valuable  in  the  event  that  questions  arise  concerning  the  format  or  the 
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wording  of  a  question.  Itie  proctor  must  be  very  careful  not  to  give  any  test 
answers  at  any  time  during  test  adninistration. 

Before  arriving  at  the  test  administration  session,  the  proctor  should 
make  sure  that  enough  test  bodclets,  answer  sheets,  #2  pencils  and,  if 
necessary,  scratcdi  paper  are  available. 

4.  Order  of  Booklet  Achninistration  and  Time  Required 

Each  individual  tdio  attends  a  JKT  session  will  be  administered  two 
booklets.  At  each  test  location,  half  of  the  examinees  will  take  one  bocdclet 
first  and  the  other  half  will  take  the  second  booklet  first.  The  purpose  of 
this  procedure  is  to  insxire  that  all  questions  are  given  equal  attention  by 
the  examinees.  Because  the  test  is  long  and  tedious,  the  questions  at  the  end 
of  the  test  may  not  receive  enough  attention.  l)ie  order  of  booklet 
administration  is  reversed  so  that  the  same  questions  are  not  always  at  the 
end  of  the  test. 

Ihe  time  allowed  for  completion  of  both  booklets  is  two  hours.  This  two 
hour  period  includes  a  ten  minute  break  idiich  should  be  taken  after  ccnpletion 
of  the  first  booklet  3uflministered.  The  break  time  should  be  arranged  so  that 
everyone  has  a  quiet  working  atmosphere  for  the  entire  testing  time.  If  an 
individual  does  not  complete  the  booklet  during  the  allowed  time,  the  proctor 
should  note  LIcafTLY  IN  PEMCIL,  near  the  name  grid  on  the  answer  sheet,  that 
the  examinee  went  over  the  allowed  time. 

5.  Answer  Sheet  and  Coding  System 

The  direction  page  for  each  test  booklet  instructs  the  examinee  on  how 
to  fill  out  the  Type  C  answer  sheets.  These  directions  are  included  in  this 
manual  on  pages  3-6  for  your  reference. 

Letter  codes  will  be  used  to  identify  functional  areas  (Phase 
Information)  and  the  order  of  booklet  administration.  These  letter  codes  will 
be  recorded  in  the  CODE  section  of  the  Type  C  answer  sheet. 


A 

B 

C 

D 

E 

F 


MAC  Phase 
MAC  Phase 
SAC  Phase 
SAC  Phase 
TAC  Phase 
TAC  Phase 


I  administered  first 

II  administered  first 

I  administered  first 

II  administered  first 

I  administered  first 

II  administered  first 
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GENERAL  ANSWER  SHEET  TYPE  C 


ei 


2  CZDCJDCZDCiDCO 
3 1  «  If  r~~ir~r~ir~o 
4  r~r^i~7~it~~~)tT~)rT~) 
5 1  «  it  r~>t  1  n  : 

6  GDCDCSCSDCO 

7  t  »  lf~7~7t  :'~tC  E  H  L  1 

8  aDCDODCiDGD 

9  rT-ir~nr~~>fr~x~r~> 

10  CZDCDGDCOCD 

11  CZDCJDCOCiDCD 

12  GDCZDCDCDCD 

13  (-nf-T-imt-rvT-> 

14  (-T-irT-irT-imrT-t 

15  gdcdcdcdcd 

16  COCEDC3DCOCD 

17  GDCDCDCDCD 

1 8  CjDCDCrDCIDCD 
i9r-r-irr-><-r~><-«->rr-i 

20  CZ3CEDCIDC3DCO 

21  CiDCEDGDCDCO 

22  GDCjDCOClDCD 

23  CZDCDCOCDCD 

24  GDCDG3COCO 

25 

26  COdDCOCIDCD 

27  GDODCrDCDCXD 

28  CZDCXaCXDCDCD 

29  COCDCZDCOOD 
30CZDCIDCIDCOCXD 

31  CjDCJDCDCDGC) 

32  CEDdDdDCZDCO 

33  GDCDd^COCO 

34  rT-^n~)rT~>rT~>r-n 

35  CZDCDCOODCID 

36  C2I)CDGZ)C3DCX) 

37  CZDCDCOCDaD 

38  COCTDCIDCDCD 

39  CZDC3DC2DCZDCD 

40  rmrT^(~r^rTyr~^ 

41  CZ3C3DCIDCDCD 
COC3DCIDCDCD 

43  CIDCDCDC3DCD 

44  COODCOCDCZD 
*5  COCJDCOCOCD 

46  GDCDCnCOCXD 

47  COdDCIDCDCD 

48  GDCDCOGDCD 

49  COCDCX3CDCZD 

50  CZDCX>CIDC3DCD 

51  COCDCX>CDCD 

52  CI3CDCOCIDCD 

53  COaDdDODCO 

54  CZDCDCEXIXXD 

55  COCDCr>GDCO 

56  COCIDGDCOCO 

57  CZ3CDCOd>aD 

58  COCDCIDCDC3D 

59  GDCDCDCDaD 

60  rT-^<-r^rT-irT-irr^ 


62  CEDCtDdDCXDQD 

63  CZDCZDCOGDCO 

65  CZDCDCDCDCO 

66  CZDGDGDCZDCO 

67  CZDCSDCZDCZDCO 

68  COCOCZDCDCtD 

69  CZDCZ:>COCIDCD 

70  CZDCOCrDCOCO 

71  CZDCOCOCSDCO 

72  CZDCOCXJCDCO' 

73  rT^r~nrT^r~nrr^ 

74  CSDCXDCOC2DCID 

75  CZDCEDGDCOCXD 

76 c  c  j 

77  GOCDCDCDCO 

78  CZ^ciDCDCEDCID 

79  GDCDCLDCOCD 

80  GDCDCOCOCD 

81  CZDCDCOCOCO 

82  CZDCDCOODCD 
63  dDCDGDCSDCZD 

84  GDCDCOODCO 

85  cZDCEDGDCSDCn) 

86  CIDC3DC3DCSDCD 

87  CZDdDCOCOCD 
*8  COCDCOCIDCD 
89  cZDCaDCXDdDCD 

98  o-irr-it-T-ir-rim 

91  fTimmfTicTi 

92  CDCEDCOCDCID 

93  CtDODCOCDCXJ 

94  r~r-)f-i~if-r7(~5~7rT-) 

95  cZDODaDCaDCID 

96  GDCEDCOCDCD 

97  gdcdcocedcxj 

98  CZDC3DCDC3DCD 

99  rT->t-T-if-L-><-r-ic-o 

100  CiDCDCZDCD^D 

101  CZ3CDCI3CDCD 

102  mcnr-nn-im 

103  r'nt-n<-nt~»~if  i  ^ 

104  rT-K-i-immm 

105  (-^"imf-nmrT-i 

106  rT-3rT-irT-it-!-irr-> 

107  rT-M-T-ir-:  n  }  im 

108  CZDCDGDCXJCD 

109  CjDCDCI3CE3CD 
110CZ3CO<_5_)CDCD 

111  CiDCrJGDCDCJD 

112  CZDCDCDCDCD 

1 13  fi~ir-n<-nmn-> 

1 14  n-imc-nmm 

115  r-r-i(-T-it-r-iCT-><~r-) 
1 18  GDCEDCZXIOCX) 

117  r7~irT~ir-r-irT~><~r~i 

118  CZJODCOCID^D 

119  fi-imr;  »t  t  xti 

120  CIDCDCDCZDCI3 
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122  GDCEiCOCZDCXD 

123  GDCXbCZDCIDCD 

124  CjDCX^GDGDCO 
25 1  *  iCT~^l  :  If  ^  Jt  I  > 
126  L-i_)l_l_JCID(_-L-»CLD 
27  rT~)(~r^rTirT:>fT~> 

1 28  GDCDCiDCiDCrD 

129  GDCDC^CXJCID 
30  GDCDCOGDCO 

131  t  *  3t  i 

132  rT^r~P7C“t~')f~r^f~Ti 

133  CiDCDC3DCOaD 

134  CZDCDCDCDOS 

135  COQD^OCOCO 
36 1  *  n  t  {  H  t  K  I  "3 

37  dDCDCDCOaD 

38  cocDcociDaD 

139  COCDCOQDCO 

140  gdcdqdcd^d 

141  rT~>r'i~*>rT~>mrT~> 

142  CXDCDCDCTDCD 

143  <~r~>r7~3rT->n~>n~) 

144  COCX3CDCDCD 

145  GDGDaDODCO 

146  GDODCOCETCD 
147 1  »  n  >  3i  t  >fT3fT~3 

148  CT3CT31~r->rT3f~r3 

149  CX5CDCEDCXXID 
l50CZDCDCX3CX>aD 
151  CPCX7CDCOCD 
i52COCDCDCDaZ> 

153  C2DC2DC2DCSDCSD 

154  mmi-ni-rx-t-i 

155  rT3mrT-)mm 
56  COODCDCISCD 
157  C2DCDCDC3DCD 
58  CTDCDCXJCDCID 

CZ^GD^DCDCD 
160  rT3(-i~>rT-»cP<~i~> 
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OOQOOOOOOOOO 
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OP  00 


^  ^P  ^P  OP  CP  ^P^P^P  ^P  QPCP  ^P  ^P  ^P  ^P  ^P  OP 
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381 


182  1— J( _ iLZJ 

183  1  ^C~  1  ■  J1 

184  ClDCXSCDCTDCD 

188  I  I 

188  CDCDCDCDCD 

187  <~nrT'ir~^m(~;^ 

188  GDCZDCDCIDCZU 
188  GDODCrDCIDCD 

170  cocDcnr^cD 

171  COCDGDCZ3Ca 

172  CSDCaDCISCOCD 

173  mmmmm 

174  CT^CDCDODCD 
178  GDODCrXXXXD 
178  a=>CDCr3C!3(=0 

177  gr*><~r><'T~i<~r~>fT~> 

178  C£7CXX2DODC3I> 
178  COCDGDCJDaD 

180  CZI^CDGDCDCO 

181  CE)03G3CZ3CX3 

182  CDCDGDClDCtD 

183  COC3DCOCX3CO 

184  GDCDdDODCO 
188  CEDCDCZDCEXXD 
188  CIDC3DCDC2DCD 

187  C2DCDCZDaDCr3 

188  CIDCIDGDCIXXi 
188  CDClDCrX3DCD 

180  dDCDCDCaCD 

181  ODODCOCncXD 

182  CDCPCDCDCP 

183  CjTCDCOCIXXJ 

184  CDODCDCDCXJ 
188  CDCIDCOCr3C3D 
188  C33CDC^ODCX3 

187  CZJODCiJtJJCD 

188  cz:>coci3cr3CZ3 
188  (_i_)<_LJCI3CIDCD 

200  ODCDCTDCOCD 

201 

202  ODODCZDCXICX) 

203  CZXUSCISODCD 

204  CZ7CDC:i3CZXX3 
208  CZ3CE3Cr)CDCX3 
208  C0CDCDO3CD 

207  CDCDGDCDCD 

208  CDCtDCZXJDCXS 
208  CiDCOCOODCrS 

210  COCDCDCJDCD 

211  t.i  x_ij<~rirrvT~> 

212  03CI3CDCXXX3 

213  CDCDCOCEXXS 

214  CjDODCDCIXID 
218  cr)CDCDcr>ci3 
218  CPCTiCTDCPCD 

217  CDCXJCOCDOD 

218  CDCI3CI3CIX30 
218  C3DCDCDCD<JD 
220  C3DCZ3GDCDCD 


222  L-i-H-i  -  jmCTI 

223  GDCDGOCOCD 

224  1  *  J1  :  3t  :  n  t  I 

228  CZDCTDCTDCZDCO 
228  GZICZDCZDCOCZD 

227  CZSCZDCDCDCID 

228  GDCIDCDGDCO 
228  COCDCOCOCD 

230  GDODGDCDCXD 

231  CZDCZDCIDCJDCXD 

232  CZDCZSCOODCO 

233  GDdDCOCZDCO 
rM  CFirrvTirrirT-i 
238  COCDCOCOCO 
238  C!DODCX3CZDCZ3 

237  czjcpcnmcD 

238  dDCXXXDCCDCD 
238  CZDCXTCOODCZD 

240  COCEXZOCIDCO 

241  CDCZDCrDCDCD 

242  cocxicoaDco 

243  C!DC3DCrDaDCO 

244  n~in~>rr-if-r-><-r-i 
248  C2DC!DG3C33C3D 
248  rT-irri<-r-irTi(-r-> 
247  C2DCXJCIDC3DCD 
2a  CSDCDCDaDCD 
248 1  1  1C-1-J1  t  jC.iLmI 

280  GDCDGDCXICD 

281  1.1 . jCOv  A  ) 

282  C3DCDCIDCDCD 

283  CDCXXJDCJDCD 

284  CJDdDCJDCSDCD 
288  CZDCDCOCDCD 
288  C3DCOCZDCOCO 

287  CZ3C3DCOCX3CO 

288  CiDCDCIDCOCD 
288  COCDdDCOCD 

280  CZDODCDCX7CO 

281  *  *  -n  1  3i  B  jt  1  I 

282  GDCDCOCX>CZ3 

283  CZ3CC>CDCDCX> 

284  CDCI3CI3C1DCD 
288  CIXXKZXSDCD 
288  CD0300CUCX3 

287  ^  ^  ■  K  C  It  ■  K  1  I 

288  CZ3C33COCX3CO 
288  CT3C13CDCDCD 

270 1  1  VT^  1  jt  ■  n  1  1 

271  <~T~>mr~!~i<~i~)rT~i 

272  GDCDCDODCO 

273  CXXX3CPC1_)CLJ 

274  C3DCDCE>C3DCO 
278  <1  V  T-X-I-K-TK-T-I 
278  COCEXZDCLJCO 
277 1  •  jfTV~rifT^t  I  I 
278  C3DCEXX3CDCD 
278 1  1  ji  ■  K  6  if  4  ji  I  1 

280  i*win13tfcitCi 


282  1  *  ifT^I  if  ■  jt  ■  1 

283  ODCIDCDCIDCD 

284  CDCjDCZ>CIDCID 

288  CZDCDCrDCZDCD 
288  ClDCOCDCOCID 

287  CDCDCOCDCO 

288  GDCDCOCIDCD 

289  CXDCDCZICrDCO 

290  CII>C2DCZ5CIDCD 

291  CZDCXJGDCTDCD 

292  CZDCDCIDaDCD 

293  COCDCTDCDCD 

294  cnmmmrT-i 
298  GDCDCXaCIDCD 
298  COCDCDCDaD 

287  GDODCIDCIDCIS 

288  CI3CX3COCIDGO 
298  CDC3DCX3CI3CD 

300  CiDCDCI3CIDC3Z> 

301  COC2DGDCOCD 

302  COODCOIZDCD 

303  COCZDCOGDirD 

304  CEDCXDCOCrDaD 

306  CDCX^CDCSDCID 
308  GDODCZDCDCD 

307  Cr3CDCZDC2DC3I) 

308  CXJC3DCDC3DCZ3 
308  CX3CtXIDCX)CD 

310  GDCOCXSCDCD 

311  GDCjDCDCEXID 

312  CDCX5CIDCIX3D 

313  CIDCIXXX2DCD 

314  COdDCDCDCD 
318 1  ■  K  I  imi-rv-i-i 
318  rT-M-nmi-rvr-i 

317  mfTH~T-i<-5->rT-> 

318  CDCDCDdXjD 
318  CiDCI5CZ)CZXI3 

320  CDCUCiDCZDaD 

321  cr3CT3(T-K-nn-i 

322  CDCXXXSCOCID 

323  CSDCDCiDaDCD 

324  omn-x-!  -11  -1  'ii-ri 
328  CDCCX^CaDOD 
328  CZ3CDCDCDCD 

327  CDCDCOCDCX) 

328  CDC33C23a3aD 
328  CZ3CPCPCD<-D 
330  CZ3CE3COC3DaD 
331 1  1  H  I  n-r-M-r-x-ri 

332  asoDCDcrxis 

333  CEXIX23C3DCD 

334  CDCDCISGDCD 

338  CIDCDCDCDCX> 

338  <T~)<-rK-i  II  I  x-r-i 

337  r~r~K*~or~r*ifrK'  7  1 
338fT~)nr><Tx-r»<-T-i 

338  fT~)rT~>rT-.rT-M-T-> 
340  CT~if-i~irT-irT->f-r-> 


343  CXDGDCDCDCD 

344  GDGDCOCDd) 
348  CZDCZJCIDCIDCD 
348  CZDODCDCOCrj 

347  CZDCOCOC3CD 

348  CIDC3DC3CDGD 

349  CIDClDCDCDCr) 

350  CiDCDGDCOCZD 

381  CXXXSCIDCDCD 

382  CDCDCDCTXJD 

383  crXIDCOODCD 

354  fT-irr->rr-)rr-v-T-> 

355  crXIDCIDCIDC3I> 

386  GDCEX3DCXX2D 

387  rT->n-n-r->fT-VT-i 
358  rrv-r-ifT-irr-ifT-i 

388  COODCDCDCD 

380  CEDODGDGDCrJ 

381  C23C2DGDCZ3CD 

382  CDCDCZDODCO 
363  n-irrir— irr-M-T-) 

384  CZXZDGDCXXTD 
388  CZDGDGDCaDCrD 

386  CZDC2DCI3CZDCD 

387  COCDCDC5DCD 

388  GDCDCDCIDCD 
388  rr-imf-nmrT-i 

370  cxiCDcracaciD 

371  CXX3DCOCZ3CO 

372  CDCDCOODCD 

373  CIXI3C3DC33CD 

374  CDCDCI3C23C2D 

375  COCDCIIiaDCX^ 

378 1  *  if">  n  1  It  a  n  1  1 

377  ^  1  in~1i  1  .H  1  It  1  1 

378  COCDCOODCO 
378  CDCDCOCEXX? 

380  CDCDCOCDCD 

381  CXDCXXZTDCXJCD 

382  CXXX^CIXXJCO 

383  COCZ3COCSCX3 

384  CDO^COC^OD 

385  CI3CDOJCUC3D 
388  CDCUCXTCDCD 

387  CDCDCDCXXID 

388  QDCDCOCXJCO 
388  0-K-LH3DCDCD 

380  COODCOCDCZD 

381  COCDCOCDCO 

382  COCZ3eZX33CO 

383  GDC0C003CD 

384  czsoDCXXisas 
388  CZXX>CZ3aDC33 
388  CZXXTCOODCD 

387  CDCDCX3<33CD 

388  Q-K-rv  -rx-rx-n 
388  CDCDCDCDCE} 
400  cacDcrxiDCD 
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REAR  PAGE  (SIDE  NO.  2) 


Directions: 


SAMPLE  FRCM  T2VSK  KNCHLEDCX!  TEST 
E«ASB  I 


Turn  your  answer  sheet  and  write  your  name  and  the  date  in  the  blocks 
provided.  Fill  in  the  corresponding  ovals.  In  the  "Numeric  Grid,"  enter  your 
SSAN  in  positions  1  through  9,  and  enter  the  number  12  in  positions  19  and  20. 
In  the  block  marked  "Sex"  blacken  the  appropriate  oval.  In  the  block  marked 
"Code"  fill  in  the  oval  designated  by  the  test  adnninistrator . 

Each  item  in  this  booklet  consists  of  a  question  or  statement  followed 
by  several  choices.  There  is  only  one  choice  that  answers  the  question  or 
completes  the  statement  correctly.  Be  sure  to  read  each  question  and  all  of 
the  choices  before  answering.  Decide  which  choice  is  correct  and  blacken  the 
letter  on  youi  answer  sheet  that  matches  the  letter  and  item  nunnber.  Here  is 
an  example: 

112.  What  is  the  capital  of  the  United  States? 

A.  Bostcxi 

B.  Philadelphia  ii2Ctdc3D^»C3DCD 

C.  Washington  D.C. 

D.  New  York 

Since  Washington  D.C.  is  the  capital  of  the  United  States,  the  answer  is 
C.  On  the  sanple  answer  sheet,  the  oval  containing  the  C  has  been  blackened. 

Be  svure  to  use  a  nunriber  2  pencil  and  blacken  only  one  oval  for  each 
item.  Erase  any  stray  marks  being  careful  not  to  tear  the  answer  sheet.  If 
you  have  to  change  an  answer,  erase  yovar  first  mark  completely,  and  then  mark 
your  new  choice. 

The  questions  in  this  booklet  are  to  be  answered  on  spaces  1  -  65  on  the 
answer  sheet  you  have  been  given.  The  questions  are  grouped  by  task.  Read 
the  task  number  and  title  at  the  top  of  each  page  to  determine  when  you  have 
started  a  new  task. 

Do  not  spend  too  much  time  on  any  one  item.  If  you  have  trouble  with  an 
item,  skip  it,  and  come  back  to  it  after  you  finish  the  other  items.  Although 
you  may  be  unfamiliar  with  a  task,  make  the  best  choice  you  can  for  each  item. 
Try  to  answer  every  item. 
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Tuk  Runber:  330 
Task  Title:  Size  and  fit  oxygen  nasks 


29.  How  many  12/P  oxygen  mask  sizes  are  there  to  choose  fton  when  fitting 
an  aircrew  member  with  a  mask? 

A.  2 

B.  3 

C.  4 

D.  5 


30.  Nhat  is  the  primary  tool  used  to  measure  an  individual's  face  when 
fitting  a  12/P  oxygen  mask? 

A.  Ruler. 

B.  Caliper. 

C.  Adjiastment  ring. 

0.  Micrometer. 


31. 


32. 


Which  portion  of  the  helmet  must  be  adjvisted  after  placing  the  helmet  on 
the  member's  head  and  prior  to  putting  the  mask  on  the  individual? 

A.  Chin  strap. 

B.  Earphones. 

C.  Nape  strap. 

D.  Helmet  liner. 

What  is  the  initial  setting  of  the  MQ-1  tdien  fitting  a  12/P  oxygen  mask? 

A.  41  M 

B.  43  M 

C.  Normal 

D.  Safety 
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Tiuk  Mijnber:  330 
Task  Title:  Size  and  fit  oxygen  nasks 


33.  How  do  you  check  for  proper  operation  of  the  inhalation/  exhalation 
valve? 

A.  Breathe  nomall y  at  the  nomal  setting  of  the  MQ-1. 

B.  Use  the  MH-2  tester. 

C.  Breathe  nomal  ly  at  the  41  M  setting  of  the  MQ-l. 

D.  Use  a  TTU-213/E. 

34.  Hhat  is  the  proper  sequence  of  adjxistments  nade  vdien  checking  the  nask 
for  proper  operation? 

A.  41  M:  43  M;  45  M;  41  M;  nomal. 

B.  Nontal;  45  M;  43  M;  41  M;  nomal. 

C.  41  M;  43  M;  45  M;  nomal;  41  M. 

D.  Nomal;  41  M:  43  M;  45  M;  41  M. 

35.  How  should  the  nask  be  adjusted  initially  after  hooking  it  vq)  to  the 
MQ-l  tester? 

A.  With  the  straps. 

B.  With  the  bayonets. 

C.  By  adjusting  the  receivers. 

D.  With  the  custom  fit  pad. 
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Tausk  Hionber:  330 
Task  Title:  Size  and  fit  oxygen  masks 


36.  At  what  setting  should  the  MQ-1  be  when  the  baycxiets  of  the  12/P  oxygen 
mask  are  first  adjxjsted? 

A.  41  M 

B.  43  M 

C.  45  M 

D.  Normal 


37.  Following  proper  mask  fit,  how  much  excess  adjustment  strap  should  be 
left  after  it  has  been  cut? 

A.  Not  less  than  1  inch,  not  more  than  3  inches. 

B.  Not  less  than  1/2  inch,  not  more  than  2  inches. 

C.  Not  less  than  1  inch,  not  more  than  4  inches. 

D.  It  doesn't  matter. 


38. 


What  type  of  cord  is  used  to  tack  the  adjustment  straps  on  a  12/P? 

A.  8/4  waxed  doubled. 

B.  8/7  waxed  singled. 

C.  8/4  unwaxed  singled. 

D.  8/7  unwaxed  doubled. 


39. 


What  type  of  knot  is  used  to  tack  the  final  fit  on  the  12/P  mask? 

A.  Bowline  knot. 


B.  Larkshead  knot  with  half  hitch  knot. 

C.  Square  knot  with  overhand  locking  knot. 

D.  Surgeon's  knot  with  overhand  locking  knot. 
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sumple  from  •osr  kncx<leoge  test 

TK 

Directicns: 

Turn  your  answer  sheet  and  write  your  name  and  the  date  in  the  blocks 
provided.  Fill  in  the  corresponding  ovals.  In  the  "Nuneric  Grid,"  enter  your 
SSAN  in  positions  1  Uurough  9,  and  enter  the  nurber  12  in  positioons  19  and  20. 
In  the  block  marked  "Sex"  blacken  the  appropriate  oval .  In  the  block  narked 
"Code"  fill  in  the  oval  designated  by  the  test  adninistrator. 

Each  item  in  this  booklet  consists  of  a  question  or  statement  followed 
by  several  choices.  Ihere  is  only  one  choice  that  answers  the  question  or 
completes  the  statement  correctly.  Be  sure  to  read  each  question  and  all  of 
the  choices  before  answering.  Decide  vdiich  choice  is  correct  aivl  blacken  the 

letter  on  your  answer  sheet  that  matches  the 
letter  and  item  number. 

Here  is  an  example: 

112.  What  is  the  capital  of  the  United  States? 

A.  Boston 

B.  Philadelphia 

C.  Washington  D.C. 

D.  New  York 

Since  Washington  D.C.  is  the  capital  of  the  United  States,  the  answer  is 
C.  On  the  sample  answer  sheet,  the  oval  containing  the  C  has  been  blackened. 

Be  sure  to  use  a  number  2  pencil  and  blacken  only  one  oval  for  each 
item.  Erase  any  stray  marks  being  careful  not  to  tear  the  answer  sheet.  If 
you  have  to  change  an  answer,  erase  your  first  mark  completely,  and  then  mark 
your  new  choice. 

The  questions  in  this  booklet  are  to  be  answered  on  spaces  66  -  133  on 
the  answer  sheet  you  have  been  given.  The  questions  are  grouped  by  task. 

Read  the  task  number  and  title  at  the  top  of  each  page  to  determine  when  you 
have  started  a  new  task. 

Do  not  spend  too  much  time  on  any  one  item.  If  you  have  trouble  with  an 
item,  skip  it,  and  come  back  to  it  after  you  finish  the  other  items.  Although 
you  may  be  unfamiliar  with  a  task,  make  the  best  choice  you  can  for  each  item. 
Try  to  answer  every  item. 
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- Task  Hurber:  278 

-Task  Title:  Periodic  inspection  on  anti-G  suit 


You  are  to  perform  a  periodic  inspection  on  an  anti-G  suit. 


105.  What  is  the  maxinun  nunnber  of  holes  allowed  in  the  anti-G  garment 
bladder  material? 

A.  2,  no  more  than  3  inches  apart. 

B.  2  per  bladder. 

C.  3  per  square  foot. 

D.  None. 


106.  What  should  be  inspected  on  the  back  waist  panel? 

A.  Metal  stays  are  not  missing,  broken,  or  protruding  though  the 
cover  material . 

B.  The  inflation  bladder  for  serviceability. 

C.  Excessive  wear  of  the  ncmex  covering  the  bladder. 

107.  What  can  be  applied  to  the  slide  fasteners  when  they  are  NOT  operating 
smoothly? 

A.  Krytox. 

B.  Sewing  machine  oil. 

C.  Wax. 

D.  WD-40. 
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Itek  Nindaer:  278 
Task  Title:  Periodic  inspecticn  on  anti-G  suit 

108.  What  is  the  miniinum  allowable  length  of  the  excess  adjustment  laces 
after  being  trinmed? 

A.  8  inches. 

B.  7  inches. 

C.  6  inches. 

D.  5  inches. 

109.  What  part  of  the  anti-G  suit  is  ONLY  visxially  checked  during  periodic 
inspection? 

A.  Snap  fasteners. 

B.  Slide  fasteners. 

C.  Lacing  cords. 

0.  Knife  lock. 

110.  What  is  the  mininun  length  of  the  cord  attached  to  the  MC-1  knife  or 
risercutter? 

A.  48  inches. 

B .  60  inches . 

C.  72  inches. 

D.  84  inches. 

111.  To  vdiat  pressure  should  the  bladders  be  inflated  during  inspection? 

A.  2  psi. 

B.  3  psi. 

C.  4  psi. 

D.  5  psi. 
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T^isk  Niniaer:  278 
Task  Title:  Periodic  inspection  on  anti-G  suit 


112.  What  should  NOT  be  used  to  inflate  the  bladders? 

A.  Hand  punnp. 

B.  Low  pressure  adr  with  a  gage. 

C.  CSU-3/P  oral  inflator  valve. 

D.  High  pressure  air  with  a  gage. 

113.  What  is  the  inaximan  allowable  leakage  after  the  bladders  have  been 
inflated? 

A.  1  psi/30  seconds. 

B.  1  psi/60  seconds. 

C.  2  psi/30  seconds. 

D.  3  psi/60  seconds. 
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APPENDIX  G:  mPT  AEMINISTRmON  GDICB.INES 


DIRECTIONS  FOR  MKOHSHOTIGN 


General  Directions 

1.  At  the  beginning  of  each  testing  session,  introduce  yourself  to  the 
incimbent  and  again  briefly  explain  exactly  what  will  occur  diuring  the 
WTFT.  Be  sure  that  the  incunbent's  answer  sheet  is  accurately  filled 
out.  Mark  all  testing  materials  you  will  be  marking  on  and  later 
transferring  to  the  incixrbent's  answer  sheet  with  the  incunbent's  name 
and  SSN. 

2 .  Ensure  that : 

a.  All  reference  materials  available  for  the  incurbent's  use  are 
readily  accessible  to  him/her  during  testing. 

b.  Any  necessary  equipment  is  available. 

c.  Any  necessary  materials  are  readily  available  for  the  incuibent's 
use. 

3.  Select  the  appropriate  test  items  for  each  incxxibent  being  evaluated. 

4.  Administer  the  tests  using  the  standardized  schedules  which  have  been 
devised.  Should  it  became  necessary  to  deviate  from  the  standard 
schedules,  organize  a  temporary  schedule  in  such  a  way  as  to  avoid 
interfering  with  the  concurrent  testing.  Include  a  break  for  the 
incumbent  and  yourself  when  necessary. 

5.  Read  the  general  instructions,  which  are  located  in  the  front  of  each 
test  booklet,  to  EVERY  incvirbent  as  soon  as  the  incunnbent  arrives  for 
the  first  testing  session.  Go  over  the  sample  interview  item  with  the 
incxxibent  and  answer  any  questions. 

6.  If  the  incvnbent  does  not  complete  a  task  within  the  allowable  time 
limit  shown  on  the  test  item,  say  to  the  inciiibent,  "That  covers  this 
task.  Let's  move  on."  If  tlte  incumbent  completes  the  session  before 
the  scheduled  time,  allow  the  incumbent  to  go  back  to  normal  work 
activities. 

7.  Follow  the  unique  instructions  provided  for  each  item,  such  as  tdiere  to 
evaluate  the  task,  time  limits,  and  necessary  equipment.  Read  all 
instructions  and  each  interview  question  to  the  incixibent  and  allow  the 
incixibent  to  read  the  same  information  from  the  instruction  or  interview 
question  notebook.  Make  a  smooth  transition  vdien  completing  one  test 
item  and  continuing  on  to  another. 

8.  Do  not  allow  the  incumbent  to  see  pages  of  the  test  booklets. 

9.  Do  not  leave  any  blanks. 
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10.  Do  not  tell  the  incunnbent  that  he/she  passed  or  failed.  Just  say  "thank 
you."  Remember,  this  is  an  evaluation  of  the  enlistment  process,  not  an 
individual . 

11.  Transfer  all  evaluations  to  the  prepared  answer  sheet  inmediately  after 
the  close  of  the  testing  session. 


Deviations 

Use  the  following  as  a  guide  for  possible  deviations  and  the  appropriate 
action  to  take. 


Jkkninistrator  Related  Deviations 

a.  Adninistrator  is  unable  to  complete  the  evaluation  because  of  illness. 

ACTION:  Reschedule  the  incumbent  for  a  time  after  all  the  previously 

scheduled  incvirbents  have  completed  their  sessions.  If  a 
task  was  interrupted,  begin  the  new  session  at  the  beginning 
of  the  task  that  was  interrupted.  If  the  original 
administrator  is  unable  to  evaluate  the  incumbent  at  this 
time,  schedule  an  alternate  administrator. 


b.  Test  booklets,  pertinent  materials,  or  interview  items  are  lost. 

ACTIC^:  Contact  the  UES  task  leader  who  will  confer  with  AEl!RL. 

Svqpply  complete  details  and  abide  by  their  final  decision. 

c.  The  incvmbent  is  unable  to  understand  the  administrator. 

ACTICW:  Exchange  incumbents  with  another  adninistrator. 

d.  Wrong  test  item  is  used  for  a  workcenter. 

ACTION:  Salvage  as  much  of  the  item  as  possible. 


Base  Related  Deviations 

a.  Base  personnel  are  unable  to  support  the  testing  procedure  because  of  an 
unscheduled  inspection  or  some  other  unforeseen  event. 

ACTICXJ:  Contact  the  UES  task  leader  who  will  confer  with  AFHRL. 

Supply  complete  details  and  abide  by  their  final  decision. 
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b.  Base  personnel  are  unable  to  provide  the  required  number  of  pec^le  to 
conplete  the  rating  forms. 

ACriCM:  Contact  UES  task  leader  who  will  confer  with  AFHRL.  Siq^ly 

complete  details  and  abide  by  their  decision. 


c.  Director  of  Personnel  (DP)  or  others  insist  on  knowing  the  evaluation 
results. 

ACTION:  Explain  to  the  DP  that  the  administrators  have  specific 

directions  from  AFEIRL  not  to  release  these  results  to  anyone 
except  AEHRL  personnel.  Inform  the  DP  that  the  incurbents 
have  been  assured  that  such  information  would  be  kept 
confidential  and  used  only  for  researcdi  pxirposes.  If  the  DP 
or  his  representative  still  insists,  give  him  the  name  and 
phone  number  of  the  AFHRL  contact. 


Bquipnent  Related  Deviations 

a.  Specific  form  or  iraterial  is  unavailable. 

ACTIOi:  Try  to  find  a  substitute.  If  a  substitute  is  not  available, 

check  with  section  chief  aiid  emit  the  step(s)  or  test  item 
if  necessary. 


b.  Correct  equipment  is  unavailable. 

ACTION:  Examine  other  options  available  and  contact  UES  Task  Leader 

for  final  procedure  to  be  followed. 

c.  Regulation  or  reference  is  unavailable. 

ACTICXI:  Try  to  find  a  local  substitute  (such  as  local  O.I.).  If 

none  is  available,  administer  item  without  reference  and 
nake  note  of  the  occurrence. 

d.  Equipment  is  unavailable  for  viewing  during  the  interview. 

ACTION:  Administer  the  test  item  anyway. 


e.  Equipment  is  damaged  during  evaluation  through  no  fault  of  the  incunbent 
or  the  damage  is  reparable. 

ACTION:  Discontinue  the  evaluation,  record  the  time  and  make  note 

of  situation  on  test  booklet.  Get  a  replacement  and  retest 
item  if  possible.  If  unable  to  find  a  replacemoit  within 
fifteen  (15)  minutes,  make  note  and  go  on  to  the  next  test 
item. 
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f.  Error  is  found  in  test,  or  recent  regulation  change  is  discovered  and 
the  steps  are  no  longer  valid. 

ACTION:  Contact  UES  Task  Leader  for  guidance. 


g.  Problems  occur  such  as  loss  of  electricity  or  heat. 

ACTION:  If  the  C8P0  personnel  continvie  to  work  then  continue  the 

evaluations.  If  the  CBPO  personnel  discontinue  work, 
discontinue  the  evaluations  and  record  the  time  directly  on 
the  test  item.  If  the  interruption  is  for  an  hour  or  less, 
record  the  restart  time  and  continue  with  the  evaluation 
even  if  it  means  keeping  the  incurbent  longer  than  the 
normal  work  day.  Be  sure  to  coordinate  this  with  the 
supervisor.  If  the  interruption  is  for  longer  than  an  hour, 
tell  the  incunbent  that  his/her  evaluation  will  be  continued 
at  a  later  date  and  allow  the  incunbent  to  go  back  to 
his/her  normal  work  area.  Reschedule  the  incunnbent  for  a 
time  after  all  the  previously  scheduled  incunbents  have 
completed  their  sessions.  Begin  the  new  session  at  the 
beginning  of  the  task  that  was  interrupted. 


h.  Natural  phenomenon  (snow  storm,  ice,  etc. )  that  might  cause  the  base  to 
shut  down. 

ACTION:  Contact  UES  task  leader  for  guidance. 


Incunbent  Related  Deviations 

a.  Incunnbent  is  unable  to  complete  evaluation  because  of  illness  or  injury. 

ACTICXi:  If  the  injury  or  illness  is  of  a  short  duration,  reschedule 

the  incuibent  for  a  time  after  all  the  previously  scheduled 
incunbents  have  completed  their  sessions.  If  a  task  was 
interrupted,  begin  the  new  session  at  the  beginning  of  the 
task  that  was  interrupted.  If  the  illness  or  injury  is  of  a 
duration  longer  than  the  team  is  scheduled  to  be  at  the 
base,  disregard  the  incunnbent 's  previous  evaluations  and 
omit  the  data. 


b.  Incuibent  is  late  for  the  testing  session. 

ACTION:  If  the  incuibent  is  less  than  an  hour  late  for  the  session, 

begin  the  evaluation  at  the  point  idiere  the  incuibent  would 
have  progressed  so  the  incuibent 's  perfocmance  does  not 
interfere  with  the  performance  of  the  other  incuibent. 
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Evaluate  the  previously  omitted  test  items  at  the  end  of  the 
session  in  the  standardized  sequence. 


c.  Incunrbent  does  not  show  up  for  testing. 

ACTION:  Reschedule  the  incurbent  for  a  time  after  all  the  previously 

scheduled  incumbents  have  completed  their  sessions. 


d.  Incumbent  takes  excessive  amount  of  time  to  perform  the  task. 

ACTION:  Stop  the  evaluation  at  the  cut-off  time  ixxlicated  on  the 

test  item.  Count  any  usianswered  questions  or  umperformed 
steps  as  incorrect.  Go  on  to  the  next  test  item. 


e.  Incumbent  is  about  to  damage  the  equipment  or  comnit  a  safety  violation. 

ACTICXI:  Stop  the  incumbent.  Tell  the  incumbent  vdiat  corrective 

action  to  take.  Consider  the  step  incorrect.  Instruct  the 
incumbent  to  go  on  to  the  next  step. 

f .  Incumbent  damages  the  equipment  or  commits  a  safety  violation. 

ACTION:  Stop  the  incumbent.  Consider  the  step  incorrect.  Instruct 

the  incumbent  to  go  on  to  the  next  step,  if  possible.  If 
damage  is  irreparable,  consider  the  test  item  failed. 


g.  Incumbent  does  not  understand  an  interview  question. 

ACTION:  Restate  the  question  as  written,  if  there  is  still  not 

understanding  -  no  credit;  incumbent  fails  the  question. 
Note  that  question  was  not  understood. 


h.  Cheating. 

ACTION:  Disregard  the  incumbent's  entire  perfomance  of  the  task. 

Note  that  cheating  occurred. 
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M»PE«DIX  H:  SAMP[£  (F  AIRCRBI  LIFE  SUPWlfr  SPBCIM.ISr 
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Ebase  I 


Bands-Gn  Task  330 


Cfciective:  To  evaluate  your  ability  to  size  and  fit  oxygen  imsks. 

Estimated  Time:  5M  Start; _ Finish: _ Time  Reg: _ 

Time  Lindt:  lOM  tTimes  Performed: _ Last  Perfonned: _ 

Tools  and  Equipment:  T.O.  15X5-3-6-1,  T.O.  15X5-3-6-12,  calipers,  MBU-12/P 
(or  5/P)  oxygen  nask  that  is  already  built,  MQ-1  tester,  ruler,  waxed 
8/4  cord,  needles,  needles,  scissors,  natches,  helmet. 

Background:  N/A 

Configuration:  Need  a  person  available  to  be  fitted.  The  nape  strap  on  the 
helmet  should  be  untied. 

Instructions  to  Administrator:  This  item  should  be  administered  in  a  quiet 
area.  The  person  being  fitted  should  be  instructed  to  indicate  that 
leaks  are  present. 


SAX  TO  TBE  maiffiEIIT 

I  WANT  yew  TO  SHOW  ME  THE  STEP-BY-STEP  PROCEDURES  WHICH  ftRE  FOLLOWED  WHQl 
YCU  SIZE  AND  FIT  AN  MBU-12/P  OR  AN  MBU-5/P  QXYGai  MASK  WITO  A  HELMET. 

THIS  TASK  IS  TO  INCLUDE  THE  TEST  AND  ADJUSTMENT  PROCEDURES.  THIS  TASK  WAS 
DEVELOPED  IN  AOOOREANCE  WITH  T.O.  15X5-3-6-1,  AND  T.O.  15X5-3-6-12.  TELL  ME 
WHEN  YOU  ARE  READY  TO  BEGIN. 

Performed  or  Answered  Correctly  YES  NO 

Did  the  incvjnibent: 

1.  Measure  the  length  of  the  subject's 
face  using  calipers  measuring  the 
distance  from  the  tip  of  the  bottom 
surface  of  the  chin  to  the  point  of 

naxinum  depression  of  the  nasal  root?  _  _ 

2.  Have  the  subject  don  the  helmet  and 

the  mask?  _ 


3.  Make  siure  that  the  helmet  nape  strap 
fit  snugly? 
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Phase  I 


Bands-Cb  Task  330 


Performsd  or  Answered  Correctly  YES 

Did  the  incurbent  say  he/ she  would: 

4.  Insert  each  bayonet  into  the  second 

locking  position  of  the  receiver?  _ 

5.  Adjust  the  straps?  _ 

6.  Plug  the  mask  into  the  Mg-l  tester?  _ 

7.  Check  the  mask  for  proper  operation 
of  the  combination  valve  by  having 
the  subject  breath  normally  in  the 

normal  setting?  _ 

8.  Turn  the  pressure  dial  to  the  41K 

setting?  _ 

9.  Adjust  straps  to  prevent  leaks?  _ 

10.  Turn  the  pressure  dial  to  the  43M 

setting?  _ 

11.  Use  the  bayonets  to  adjust  for  leaks?  _ 

12.  Turn  the  pressure  dial  to  the  45M 

setting?  _ 

13.  Use  the  bayonets  to  adjiist  for  leaks?  _ 

14.  Return  the  regulator  to  the  41M  setting?  _ 

15.  Re-adjust  bayonets  to  second  locking 

position?  _ 

16.  Cut  excess  adjustment  strap  leaving  not 

less  than  1  inch  or  more  than  3  inches?  _ 

17.  Sear  the  cut  ends?  _ 

18.  Tack  the  adjustment  straps  with  doubled 
waxed  8/4  cord  using  two  turns  and  tie 
the  tacking  thread  with  a  surgeon's  knot 

and  secure  with  a  locking  knot?  _ 


Time  Required 


NO 
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0VE3»LL  PERFORMANCE 


5  Far  exceeds  the  acceptable  level  of  proficiency 
4  Somewhat  exceeded  the  acceptable  level  of  proficiency 
3  Met  the  acceptable  level  of  proficiency 
2  Somewhat  below  the  acceptable  level  of  proficiency 
1  Far  below  the  acceptable  level  of  proficiency 
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Phase  I 


Interview  I^ask  330 


Cfeiective:  To  evaluate  your  knowledge  of  the  procedures  necessary  to  size  and 
fit  oxygen  nasks. 

Estimated  Time:  5M  Start: _ Finish: _ Tire  Rea: _ 

Tire  Lindt:  lOM  tTimes  Performed: _ Last  Performed: _ 

Tools  and  Equiucnent:  N/A 
Background:  N/A 
Configuration:  N/A 

Instructions  to  Adidnistrator :  This  item  should  be  administered  in  a  quiet 
area. 


SAT  TO  THE  DiCCMBan' 

I  WANT  YOU  TO  TELL  ME  TOE  STEP-BY-STEP  PROCEDURES  WHICH  ARE  FOLLOWED  WHEN  YOU 
SIZE  AND  FIT  AN  MBU-12/P  CaCYGEH  MASK  WITO  A  HEliffiT.  THIS  TASK  IS  TO  INCLUDE 
TOE  TEST  AND  ADJUSTMENT  PROCEDURES.  PLEASE  BE  AS  DETAILED  AS  POSSIBLE  IN  YOUR 
DESCRIPTICNS.  THIS  TASK  WAS  MVELOPED  IN  ACCORDANCE  WITO  T.O.  15X5-3-6-1  AND 
15X5-3-6-12.  TELL  ME  WHEN  YOU  ARE  READY  TO  BEGIN. 


Performed  or  Answered  Correctly  YES  NO 

Did  the  incumbent: 

1.  Measure  the  length  of  the  subject's  face 
using  calipers  measuring  the  distance  from 
the  tip  of  the  bottom  svurface  of  the  chin 
to  the  point  of  maximum  depression  of  the 
nasal  root?  _ 


2.  Have  the  subject  don  the  helmet  and  the 
mask? 


3.  Make  sure  that  the  helmet  nape  strap  fit 
snugly? 

4.  Insert  each  bayonet  into  the  second 
locking  position  of  the  receiver? 

5.  Adjust  the  straps? 
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Phase  I 


Interview  Task  330 


Perfonned  or  Answered  Correctly  YES 

Did  the  incumbent  say  he/she  would: 

6.  Plug  the  mask  into  the  tester?  _ 

7.  Check  the  mask  for  proper  operation 
of  the  combination  valve  by  having 
the  subject  breath  normally  in  the 

normal  setting?  _ 

8.  Turn  the  pressure  dial  to  the  41M 

setting?  _ 

9.  Adjust  straps  to  prevent  leaks?  _ 

10.  Turn  the  pressure  dial  to  the  43M 

setting?  _ 

11.  Use  the  bayonets  to  adjust  for  leaks?  _ 

12.  Turn  the  pressure  dial  to  the  45iM 

setting?  _ 

13.  Use  the  bayonets  to  adjust  for  leaks?  _ 

14.  Return  the  regulator  to  the  41M  setting?  _ 

15.  Re-adjust  bayonets  to  second  locking 

position?  _ 

16.  Tack  the  adjustment  straps  with  doubled 
waxed  8/4  cord  using  two  turns  and  tie 
the  tacking  thread  with  a  surgeon's  knot 

and  secure  with  a  locking  knot?  _ 


Time  Required 


NO 
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CVmLL  PESPOraANCE 

5  Far  exceeds  the  acc^table  level  of  proficiency 
4  Sonewhat  exceeded  the  acceptable  level  of  proficiency 
3  Met  the  acceptable  level  of  proficiency 
2  Somewhat  below  the  acceptable  level  of  proficiency 
1  Far  below  the  acceptable  level  of  proficiency 
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Aase  II  TAC 


Hands-Ob  Task  278 


(feiective:  To  evaluate  your  ability  to  perfom  the  anti-G  suit  periodic 
inspection. 

Estinated  Time:  15M  Start; _ Finish: _ Time  Reg: _ 

Time  Limit:  20M  iTimes  Performed: _ Last  Performed: _ 


Tools  and  Equiwnent:  T.O.  14P3-6-121,  air  punp,  wax,  ruler,  wax  pot  with 
melted  wax,  watch,  tape,  matches  or  lighter,  100  lb.  nylon  cord  00 
green,  CSU-13B/P  anti-G  suit,  AE*ro  Form  335. 

Backqroxmd;  N/A 

Configuration:  CSU-13B/P  anti-G  suit  with  an  MC-1  knife  or  riser  cutter  and 
with  metal  stays  and  the  AFTO  Form  335  for  this  anti-G  suit. 

Instructions  to  Administrator:  Administer  at  any  workstation  near  the  air 
pump. 


SAT  TO  THE  HKXMBOIT 

I  WANT  YOU  TO  PERFORM  TOE  ANTI-G  SUIT  PERIODIC  INSPECTION.  PLEASE  INCLUDE  ALL 
STEPS.  THIS  TASK  WAS  DEVELOPED  IN  ACCORDANCE  WITH  T.O.  14P3-6-121.  INDICATE 
TO  ME  WHEN  YOU  ARE  READY  TO  BEGIN. 

Performed  or  Answered  Correctly  YES  NO 

Did  the  incumbent: 

1.  Visually  inspect  outer  fabric  for  snags, 

tears,  and  holes?  _  _ 


2.  Inspect  the  back  waist  panel  to  ensure 
that  the  metal  stays  were  not  missing, 
broken  or  protruding  through  the  cover 
material? 


3.  Inspect  all  slide  fasteners  for  service¬ 
ability  and  check  for  corrosion  and 
missing  teeth? 

4.  Inspect  velcro-hook  fastener  tapes  for 
serviceabi 1 ity? 

5.  Check  lacing  cord  for  frays? 
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Itese  II  TRC 


Hands-Ob  Task  278 


Performed  or  Answer  Correctly  YES 

Did  the  incvxrbent: 

6.  Inspect  the  snap  fasteners  and  hook 
assemblies  for  proper  clinch  and 

operation?  _ 

7.  Inspect  the  garment  disconnect  for 

corrosion  and  cracks?  _ 

8.  Inspect  MC-1  knife  or  riser  cutter 

for  serviceability  and  corrosion?  _ 

9.  Inspect  the  nylon  cord  for  frays?  _ 

10.  Ensure  that  the  nylon  cord  was  a 

miniitun  length  of  60  inches?  _ 

11.  Inflate  bladders  to  5  PSI  using  low 

pressure  air  with  gavtge?  _ 

12.  Cut  off  input  air  source?  _ 

13.  Make  sure  the  leakage  was  no  more 

than  one  PSI  in  one  minute?  _ 

14.  Record  inspection  on  AFTO  Form  335?  _ 


Time  Required 


NO 


158 


0VE3%ALL  PE3lPCS9ffiNCE 


5  Far  exceeds  the  acceptable  level  of  proficiency 
4  Somewhat  exceeded  the  acceptable  level  of  proficiency 
3  Met  the  acceptable  level  of  proficiency 
2  Somewhat  below  the  acceptable  level  of  proficiency 
1  Far  below  the  acceptable  level  of  proficiency 
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jgPBlDIX  I;  SMfPIf  CF  MSCKSt  LIFE  SDFPCRT  SPECIALIST 
(AFS  122X0)  HTPT  INCUMBQIT  MAMDAL 
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GCMSOL  mCGHBaiT  ufsnsjcncK 


YOU  HAVE  BEE2f  SELECTTED  TO  PARTICIPATE  IN  AN  AIR  FORCE  RE^ARCH  PROJECT 
TO  EVALUATE  THE  ENLISTED  SELECTION  PROCESS  FOR  'IHE  AFS  122X0  CAREER  FIELD.  AS 
PART  CF  THIS  RESEARCH,  YOU  AND  OTHER  FIRST-TERM  AIRMEN  HILL  BE  GIVEN  A  SERIES 
CF  TEST  ITEMS  I^ICatED  TO  ASSESS  YOUR  ABILITY  TO  PERFORM  A  NUIBER  OF  SELECTED 
TASKS.  THE  TOTAL  TEST  WILL  TAKE  BEIWESN  FOUR  TO  SIX  HOURS  TO  COMPLETE. 

ALL  OF  YOUR  TEST  SCORES  WILL  BE  KEPT  OONFIISNTIAL .  WHILE  I  WILL  BE 
ASSESSING  YOUR  PERFORMANCE  LEVEL,  IT  IS  VERY  IMPORTANT  FCR  YOU  TO  UNIXRSTAND 
HAT  THERE  IS  NO  PASS/FAIL  SCORE  FOR  THIS  TEST.  WE  ARE  INVESTIGATING  THE 
ENLISTED  SELECTION  PROCESS  FCR  YOUR  CAREER  FIELD  AND  NOT  YOU  PERSONALLY.  YOUR 
TEST  SCORES  HILL  NOT  GO  IN  YOUR  RECORDS  NCR  BE  REVEALED  TO  YOUR  CO-WORKERS  OR 
SUPERVISORS.  YOUR  SCORES  CANNOT  AFEECT  YOUR  APR. 

YOU  WILL  BE  AEMINISTERED  TWO  TYPES  OF  TEST  ITEMS.  ONE  TYPE  (HANDS-ON 
TYPE)  WILL  REQUIRE  YOU  TO  PERFOW  A  TASK.  THE  OTHER  TYPE  (INTERVIEW  TYPE) 

WILL  REQUIRE  YOU  TO  TELL  ME  STEP-BY-STEP  AND  IN  AS  MUCH  ISTTAIL  AS  POSSIBLE, 

HOW  YOU  WOULD  PERFORM  A  TASK.  FOR  SOME  TASKS,  YOU  WILL  BE  GIVEN  THE  TECHNICAL 
DATA  (T.O.s)  AND  EQUIPMENT  NECESSARY  TO  PERFORM  THOSE  TASKS.  FOR  OTHER  TASKS 
YOU  WILL  BE  REQUIRED  TO  IIMITIFY  AND  CBTAIN  THE  NECESSARY  T.O.s  AND  EQUIPMENT. 
YOU  MAY  BE  ASKED  TO  PERFORM  SOME  TASKS  THAT  YOU  HAVE  NOT  PERFORMED  BEFORE.  IN 
THESE  CASES  DO  THE  BEST  YOU  CAN.  SOME  TASKS  REQUIRE  MORE  TIME  TO  COMPLETE 
THAN  HE  HAVE  TIME  TO  EVALUATE.  SO  DO  NOT  BE  ALARMED  IF  I  ASK  YOU  TO  PERFORM 
ONLY  A  PORTION  OF  A  TASK  OR  IF  I  ASK  YOU  TO  STOP  A  TASK  BEFORE  YOU  HAVE 
FINISHED. 

DURING  THE  AEMINISTRATION  OF  THIS  T^  I  WILL  ONLY  BE  ABLE  TO  ANSWER 
QUESTIONS  IXRLING  WITH  THE  AEMINISTRATION  OF  THE  TEST  ITEMS.  PLEASE  DO  NOT 
ASK  ANY  QUESTIONS  ABOUT  THESE  TASKS  UNLESS  YOU  DO  NOT  UNDERSTAND  THE 
DIRECTIONS.  PLEASE  DO  NOT  TELL  OTHERS  WHAT  QUESTIONS  YOU  WERE  ASKED  OR  WHAT 
TASKS  YOU  PERFC^MED  SO  THE  TEST  WILL  BE  THE  SAME  FOR  EVERYONE. 

BEFORE  WE  BEGIN  THE  FIRST  SCORED  ITEM,  I  WILL  SHOW  YOU  AN  EXAMPLE  OF  AN 
INTERVIEW  ITEM  AND  SHOW  YOU  WHAT  WE  WOULD  LIKE  YOU  TO  ANSWER  IN  TQ^  OF 
DETAIL  AND  AMOUNT  OF  INFORMATION. 
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Phase  I 


Interview  Task  330 


C^jective:  To  evaluate  your  knowledge  of  the  procedures  necessary  to  size  and 
fit  oxygen  masks. 


I  WANT  YOU  TO  TELL  ME  TOE  STEP-BY-STEP  PROCEDURES  WHICH  ARE  FOLLOWED  WHEM  YOU 
SIZE  AND  FIT  AN  MBU-12/P  OXYGEH  MASK  WITO  A  HEIMET.  TOIS  TASK  IS  TO  INCUJDE 
TOE  TEST  AND  ADJUSTMEHT  PROCEDURES.  PLEASE  BE  AS  DETTAILED  AS  POSSIBLE  IN  YOUR 
DESCRIPTIONS.  TOIS  TASK  WAS  DEVELOPED  IN  ACCORDANCE  WITO  T.O.  15X5-3-6-1  AND 
15X5-3-6-12.  TELL  ME  WHEW  YOU  ARE  READY  TO  BEGIN. 
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Phase  I 


Hands-Cn  Task  330 


(Elective:  To  evaluate  your  knowledge  of  the  procedures  necessary  to  size  and 
fit  oxygen  nasks. 


I  WANT  YOU  TO  SHOW  ME  IHE  STEP-BY-STEP  Fl^XEDURES  WHIC31  ARE  FOLLOWED  WHEN  YOU 
SIZE  AND  FIT  AN  MBU-12/P  CR  AN  MBU-5/P  OXYGEN  MASK  WITO  A  HELMET.  THIS  TASK 
IS  TO  INCLUDE  THE  TEST  AND  ADJUSTMENT  PROCEDURES.  THIS  TASK  WAS  ISVELOPED  IN 
ACCORDANCE  WITH  T.O.  15X5-3-6-1  AND  15X5-3-6-12.  TELL  ME  WHEN  YOU  ARE  READY 
TO  BEGIN. 
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Phase  II  The 


Hands-On  Task  278 


Cfeiective:  To  evaluate  your  ability  to  perform  the  anti-G  suit  periodic 
inspection. 


I  WANT  YOU  TO  PERFORM  TOE  ANTI-G  SUIT  PERIODIC  INSPECTION.  PLEASE  INCLUDE  ALL 
STEPS.  THIS  TASK  WAS  MVELOPED  IN  ACOCRDANCE  WITH  T.O.  14P3-6-121.  INDICATE 
TO  ME  WHEN  YOU  ARE  READY  TO  BEGIN. 
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* 


APPHiDIX  j;  fnPT  AHSHER  SEET 
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INCUMBENrS  NAME: 
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UPPEHDJX.  K;  JEMS  gUKbTlGnniRE 
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3IKS  qaEgnowpoRE 


NAME  _ 

Last 


First 


Ml 


SSAN 


For  the  following  statements  we  are  interested  in  your  beliefs  about  the 
Hands-On/ Interview  testing.  Please  respond  to  each  statement  using  the 
scale  provided  below.  Eiiter  the  nurber  that  best  represents  your  opinion 
in  the  blank  space  provided  by  each  statement. 


Not  at  To  a  Snnall  To  a  Moderate  To  a  Great  To  a  Very 
All  Extent  Extent  Extent  Great  Extent 

U _ ! _ / _ / _ ! _ 

1  2  3  4  5 


1.  _  Did  you  feel  it  was  iirportant  to  perform  well  on  the  test? 

2.  _  Are  you  satisfied  that  you  performed  as  well  as  you  could  on  the 

test? 

3.  _  Does  the  test  provide  a  true  picture  of  your  performance  level? 

4.  Did  you  care  how  well  you  performed  on  the  test? 

5.  _  Did  you  find  the  test  interesting? 

6.  _  Did  you  make  an  "extra  effort"  to  carefully  pay  attention  to  all  of 

the  instructions  and  exarnples  in  order  to  perform  well? 

7.  _  How  motivated  were  you  to  perform  to  the  best  cf  your  ability  on  the 

test? 

8.  _  Do  you  believe  that  the  true  purpose  of  the  test  was  the  one 

explained  to  you  by  the  test  adnninistrator? 

9.  _  Do  you  trust  that  the  information  collected  from  you  in  this  test 

will  be  used  for  research  purposes  only? 

10.  _  Will  your  st^rvisor  have  access  to  any  information  collected  about 

you  from  this  test? 
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For  the  following  questions,  please  also  coansider  the  nul tipi e-choice  job 
knowledge  test  you  took  earlier  in  the  we^. 

Not  at  To  a  Small  To  a  Moderate  To  a  Great  To  a  Very 
All  Extent  Extent  Extent  Great  Extent 

U _ f _ ! _ ! _ ! _ 

1  2  3  4  5 

Is  the  test  acceptable  to  you  as  a  way  to  detennine  job  proficiency? 

11.  _  Hands-on  test 

12.  _  Interview  test 

13.  _  Job  knowledge  test 

Did  the  test  evaluate  your  job  proficiency  fairly? 

14.  _  Hands-on  test 

15.  _  Interview  test 

16.  _  Job  knowledge  test 

Will  the  results  of  this  test  be  useful  to  the  Air  Force? 

17.  _  Hands-on  test 

18.  _  Interview  test 

19.  _  Job  knowledge  test 

Is  the  test  easy  to  use  and  understandable  as  a  means  of  determining 
job  proficiency? 

20.  _  Hands-on  test 

21.  _  Interview  test 

22.  _  Job  knowledge  test 

Could  someone  tell  the  difference  between  good  and  poor  performers  by  looking 
at  the  results  of  the  test? 

23.  _  Hands-on  test 

24.  _  Interview  test 

25.  _  Job  knowledge  test 
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Not  at  To  a  antall  To  a  Moderate  To  a  Great  To  a  Very 
All  Extent  Extent  Extent  Great  Extent 

_/ _ ! _ ! _ ! _ / 

1  2  3  4  5 


If  scneone  were  to  look  at  the  results  of  the  test,  could  they  get  a  true 
picture  of  the  perfornance  level  of  the  person  vdio  took  the  test? 


26.  _ 

_  Hands-on  test 

27.  _ 

_  Interview  test 

28.  _ 

_  Job  knowledge  test 

How  well  did  the  instructions  you  received  at  the  beginning  of  each  section 
prepare  you  to  acconplish  that  section? 


29.  _ 

_  Hands-on  test 

30.  _ 

_  Interview  test 

31.  _ 

_  Job  knowledge  test 

What  iirprovements  would  you  nake  in  the  instructions  for  the  hands-on  and 
interview  testing? 


32.  _  How  well  was  the  iirportance  of  this  Perfornance  Measurement 

program  to  the  Air  Force  expressed  in  the  orientation  you 
received? 

33.  _  Will  the  information  collected  for  this  Performance  Measurement 

program  be  used  for  actual  performance  reports  or  other 
acbninistrative  purposes? 
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Thii^  back  on  all  of  the  rating  forms,  hands-on/ interview  tasks,  and  the  job 
knowledge  test  completed  during  this  project.  Please  rank  the  following  on 
their  ability  to  provide  accurate  and  useful  information  about  201  individual’ 
performance.  (1  =  Best, 4  =  Worst) 


34.  _ 

_  Rating  Forms 

35.  _ 

_  Job  Knowledge  Test 

36.  _ 

_  Hands-on  Test 

37.  _ 

_  Interviews 

Additional  Remarks/Conments : 
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